Nov 11 01:25:07 user nova-compute[75215]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75215) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75215) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75215) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 11 01:25:07 user nova-compute[75215]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:25:07 user nova-compute[75215]: INFO nova.virt.driver [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 11 01:25:07 user nova-compute[75215]: INFO nova.compute.provider_config [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] Acquiring lock "singleton_lock" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] Acquired lock "singleton_lock" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] Releasing lock "singleton_lock" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] Full set of CONF: {{(pid=75215) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ******************************************************************************** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] Configuration options gathered from: {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ================================================================================ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] allow_resize_to_same_host      = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] arq_binding_timeout            = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] backdoor_port                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] backdoor_socket                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] block_device_allocate_retries  = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] block_device_allocate_retries_interval = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cert                           = self.pem {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute_monitors               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] config_dir                     = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] config_drive_format            = iso9660 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] config_source                  = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] console_host                   = user {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] control_exchange               = nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cpu_allocation_ratio           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] daemon                         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] debug                          = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] default_access_ip_network_name = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] default_availability_zone      = nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] default_ephemeral_format       = ext4 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] default_green_pool_size        = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] default_schedule_zone          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] disk_allocation_ratio          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] enable_new_services            = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] enabled_ssl_apis               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] flat_injected                  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] force_config_drive             = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] force_raw_images               = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] graceful_shutdown_timeout      = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] heal_instance_info_cache_interval = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] host                           = user {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] instance_build_timeout         = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] instance_delete_interval       = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] instance_name_template         = instance-%08x {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] instance_usage_audit           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] instance_usage_audit_period    = month {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] internal_service_availability_zone = internal {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] key                            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] live_migration_retry_count     = 30 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] log_config_append              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] log_dir                        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] log_file                       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] log_options                    = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] log_rotate_interval            = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] log_rotate_interval_type       = days {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] log_rotation_type              = none {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] long_rpc_timeout               = 1800 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] max_concurrent_builds          = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] max_concurrent_live_migrations = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] max_concurrent_snapshots       = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] max_local_block_devices        = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] max_logfile_count              = 30 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] max_logfile_size_mb            = 200 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] maximum_instance_delete_attempts = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] metadata_listen                = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] metadata_listen_port           = 8775 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] metadata_workers               = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] migrate_max_retries            = -1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] mkisofs_cmd                    = genisoimage {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] my_ip                          = 10.0.0.210 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] network_allocate_retries       = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] osapi_compute_listen_port      = 8774 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] osapi_compute_unique_server_name_scope =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] osapi_compute_workers          = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] password_length                = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] periodic_enable                = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] periodic_fuzzy_delay           = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] pointer_model                  = ps2mouse {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] preallocate_images             = none {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] publish_errors                 = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] pybasedir                      = /opt/stack/nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ram_allocation_ratio           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] rate_limit_burst               = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] rate_limit_except_level        = CRITICAL {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] rate_limit_interval            = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] reboot_timeout                 = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] reclaim_instance_interval      = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] record                         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] reimage_timeout_per_gb         = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] report_interval                = 120 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] rescue_timeout                 = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] reserved_host_cpus             = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] reserved_host_disk_mb          = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] reserved_host_memory_mb        = 512 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] reserved_huge_pages            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] resize_confirm_window          = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] resize_fs_using_block_device   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] resume_guests_state_on_host_boot = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] rpc_response_timeout           = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] run_external_periodic_tasks    = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] running_deleted_instance_action = reap {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] running_deleted_instance_timeout = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler_instance_sync_interval = 120 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_down_time              = 720 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] servicegroup_driver            = db {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] shelved_offload_time           = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] shelved_poll_interval          = 3600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] shutdown_timeout               = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] source_is_ipv6                 = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ssl_only                       = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] state_path                     = /opt/stack/data/nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] sync_power_state_interval      = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] sync_power_state_pool_size     = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] syslog_log_facility            = LOG_USER {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] tempdir                        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] timeout_nbd                    = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] transport_url                  = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] update_resources_interval      = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] use_cow_images                 = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] use_eventlog                   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] use_journal                    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] use_json                       = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] use_rootwrap_daemon            = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] use_stderr                     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] use_syslog                     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vcpu_pin_set                   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plugging_is_fatal          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plugging_timeout           = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] virt_mkfs                      = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] volume_usage_poll_interval     = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] watch_log_file                 = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] web                            = /usr/share/spice-html5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.auth_strategy              = keystone {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.compute_link_prefix        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.dhcp_domain                = novalocal {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.enable_instance_password   = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.glance_link_prefix         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.instance_list_per_project_cells = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.list_records_by_skipping_down_cells = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.local_metadata_per_cell    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.max_limit                  = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.metadata_cache_expiration  = 15 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.neutron_default_tenant_id  = default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.use_forwarded_for          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.use_neutron_default_nets   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.vendordata_dynamic_targets = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.vendordata_jsonfile_path   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.backend_argument         = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.config_prefix            = cache.oslo {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.dead_timeout             = 60.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.debug_cache_backend      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.enable_retry_client      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.enable_socket_keepalive  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.enabled                  = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.expiration_time          = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_dead_retry      = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_password        =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_sasl_enabled    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.memcache_username        =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.proxies                  = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.retry_attempts           = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.retry_delay              = 0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.socket_keepalive_count   = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.socket_keepalive_idle    = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.socket_keepalive_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.tls_allowed_ciphers      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.tls_cafile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.tls_certfile             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.tls_enabled              = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cache.tls_keyfile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.auth_section            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.auth_type               = password {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.cafile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.certfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.collect_timing          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.cross_az_attach         = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.debug                   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.endpoint_template       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.http_retries            = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.keyfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.os_region_name          = RegionOne {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.split_loggers           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cinder.timeout                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.cpu_dedicated_set      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.cpu_shared_set         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.image_type_exclude_list = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.resource_provider_association_refresh = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.shutdown_retry_interval = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] conductor.workers              = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] console.allowed_origins        = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] console.ssl_ciphers            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] console.ssl_minimum_version    = default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] consoleauth.token_ttl          = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.cafile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.certfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.collect_timing          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.connect_retries         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.connect_retry_delay     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.endpoint_override       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.keyfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.max_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.min_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.region_name             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.service_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.service_type            = accelerator {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.split_loggers           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.status_code_retries     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.timeout                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] cyborg.version                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.backend               = sqlalchemy {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.connection            = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.connection_debug      = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.connection_parameters =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.connection_recycle_time = 3600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.connection_trace      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.db_inc_retry_interval = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.db_max_retries        = 20 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.db_max_retry_interval = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.db_retry_interval     = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.max_overflow          = 50 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.max_pool_size         = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.max_retries           = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.pool_timeout          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.retry_interval        = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.slave_connection      = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] database.sqlite_synchronous    = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.backend           = sqlalchemy {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.connection        = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.connection_debug  = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.connection_parameters =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.connection_recycle_time = 3600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.connection_trace  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.db_inc_retry_interval = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.db_max_retries    = 20 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.db_max_retry_interval = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.db_retry_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.max_overflow      = 50 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.max_pool_size     = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.max_retries       = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.pool_timeout      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.retry_interval    = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.slave_connection  = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] api_database.sqlite_synchronous = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] devices.enabled_mdev_types     = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ephemeral_storage_encryption.enabled = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.api_servers             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.cafile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.certfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.collect_timing          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.connect_retries         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.connect_retry_delay     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.debug                   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.default_trusted_certificate_ids = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.enable_certificate_validation = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.enable_rbd_download     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.endpoint_override       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.keyfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.max_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.min_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.num_retries             = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.rbd_ceph_conf           =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.rbd_connect_timeout     = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.rbd_pool                =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.rbd_user                =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.region_name             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.service_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.service_type            = image {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.split_loggers           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.status_code_retries     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.timeout                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.verify_glance_signatures = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] glance.version                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] guestfs.debug                  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.config_drive_cdrom      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.config_drive_inject_password = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.enable_remotefx         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.instances_path_share    =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.limit_cpu_features      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.use_multipath_io        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.vswitch_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] mks.enabled                    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] image_cache.manager_interval   = 2400 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] image_cache.precache_concurrency = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] image_cache.remove_unused_base_images = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] image_cache.subdirectory_name  = _base {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.api_max_retries         = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.api_retry_interval      = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.auth_section            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.auth_type               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.cafile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.certfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.collect_timing          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.conductor_group         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.connect_retries         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.connect_retry_delay     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.endpoint_override       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.keyfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.max_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.min_version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.peer_list               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.region_name             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.serial_console_state_timeout = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.service_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.service_type            = baremetal {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.split_loggers           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.status_code_retries     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.timeout                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ironic.version                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] key_manager.fixed_key          = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.barbican_api_version  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.barbican_endpoint     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.barbican_endpoint_type = public {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.barbican_region_name  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.cafile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.certfile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.collect_timing        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.insecure              = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.keyfile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.number_of_retries     = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.retry_delay           = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.send_service_user_token = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.split_loggers         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.timeout               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.verify_ssl            = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican.verify_ssl_path       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.auth_section = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.auth_type = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.cafile   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.certfile = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.collect_timing = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.insecure = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.keyfile  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.split_loggers = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] barbican_service_user.timeout  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.approle_role_id          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.approle_secret_id        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.cafile                   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.certfile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.collect_timing           = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.insecure                 = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.keyfile                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.kv_mountpoint            = secret {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.kv_path                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.kv_version               = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.namespace                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.root_token_id            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.split_loggers            = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.ssl_ca_crt_file          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.timeout                  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.use_ssl                  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.auth_section          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.auth_type             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.cafile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.certfile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.collect_timing        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.connect_retries       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.connect_retry_delay   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.endpoint_override     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.insecure              = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.keyfile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.max_version           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.min_version           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.region_name           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.service_name          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.service_type          = identity {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.split_loggers         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.status_code_retries   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.timeout               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] keystone.version               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.connection_uri         =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.cpu_mode               = custom {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: WARNING oslo_config.cfg [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.cpu_power_governor_high = performance {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.cpu_power_management   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.device_detach_attempts = 8 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.device_detach_timeout  = 20 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.disk_cachemodes        = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.disk_prefix            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.enabled_perf_events    = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.file_backed_memory     = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.gid_maps               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.hw_disk_discard        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.hw_machine_type        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.images_rbd_pool        = rbd {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.images_type            = default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.images_volume_group    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.inject_key             = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.inject_partition       = -2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.inject_password        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.iscsi_iface            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.iser_use_multipath     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_downtime = 500 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_inbound_addr = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_scheme  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_timeout_action = abort {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_tunnelled = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: WARNING oslo_config.cfg [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 11 01:25:07 user nova-compute[75215]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 11 01:25:07 user nova-compute[75215]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 11 01:25:07 user nova-compute[75215]: and ``live_migration_inbound_addr`` respectively.
Nov 11 01:25:07 user nova-compute[75215]: ).  Its value may be silently ignored in the future.
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.live_migration_with_native_tls = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.max_queues             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.nfs_mount_options      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.num_pcie_ports         = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.pmem_namespaces        = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.quobyte_client_cfg     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rbd_secret_uuid        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rbd_user               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rescue_image_id        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rescue_kernel_id       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.rx_queue_size          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.smbfs_mount_options    =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.snapshot_compression   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.snapshot_image_format  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.sparse_logical_volumes = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.swtpm_enabled          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.swtpm_group            = tss {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.swtpm_user             = tss {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.sysinfo_serial         = unique {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.tb_cache_size          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.tx_queue_size          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.uid_maps               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.use_virtio_for_bridges = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.virt_type              = kvm {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.volume_clear           = zero {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.volume_clear_size      = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.volume_use_multipath   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.vzstorage_cache_path   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.auth_section           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.auth_type              = password {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.cafile                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.certfile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.collect_timing         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.connect_retries        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.connect_retry_delay    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.default_floating_pool  = public {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.endpoint_override      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.extension_sync_interval = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.http_retries           = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.insecure               = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.keyfile                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.max_version            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.min_version            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.ovs_bridge             = br-int {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.physnets               = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.region_name            = RegionOne {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.service_metadata_proxy = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.service_name           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.service_type           = network {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.split_loggers          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:07 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.status_code_retries    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.timeout                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] neutron.version                = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] notifications.bdms_in_notifications = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] notifications.default_level    = INFO {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] notifications.notification_format = unversioned {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] notifications.notify_on_state_change = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] pci.alias                      = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] pci.device_spec                = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] pci.report_in_placement        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.auth_section         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.auth_type            = password {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.cafile               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.certfile             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.collect_timing       = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.connect_retries      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.connect_retry_delay  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.default_domain_id    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.default_domain_name  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.domain_id            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.domain_name          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.endpoint_override    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.insecure             = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.keyfile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.max_version          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.min_version          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.password             = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.project_domain_id    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.project_domain_name  = Default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.project_id           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.project_name         = service {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.region_name          = RegionOne {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.service_name         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.service_type         = placement {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.split_loggers        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.status_code_retries  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.system_scope         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.timeout              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.trust_id             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.user_domain_id       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.user_domain_name     = Default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.user_id              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.username             = placement {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] placement.version              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.cores                    = 20 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.count_usage_from_placement = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.injected_file_content_bytes = 10240 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.injected_file_path_length = 255 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.injected_files           = 5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.instances                = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.key_pairs                = 100 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.metadata_items           = 128 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.ram                      = 51200 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.recheck_quota            = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.server_group_members     = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] quota.server_groups            = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] rdp.enabled                    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.image_metadata_prefilter = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.max_attempts         = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.max_placement_results = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] scheduler.workers              = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.host_subset_size = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.isolated_hosts = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.isolated_images = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.pci_in_placement = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.track_instance_changes = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] metrics.required               = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] metrics.weight_multiplier      = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] metrics.weight_setting         = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] serial_console.enabled         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] serial_console.port_range      = 10000:20000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] serial_console.serialproxy_port = 6083 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.auth_section      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.auth_type         = password {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.cafile            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.certfile          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.collect_timing    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.insecure          = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.keyfile           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.send_service_user_token = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.split_loggers     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] service_user.timeout           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.agent_enabled            = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.enabled                  = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.html5proxy_port          = 6082 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.image_compression        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.jpeg_compression         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.playback_compression     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.server_listen            = 127.0.0.1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.streaming_mode           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] spice.zlib_compression         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] upgrade_levels.baseapi         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] upgrade_levels.cert            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] upgrade_levels.compute         = auto {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] upgrade_levels.conductor       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] upgrade_levels.scheduler       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.cafile = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.certfile = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.insecure = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vendordata_dynamic_auth.timeout = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.api_retry_count         = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.ca_file                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.cache_prefix            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.cluster_name            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.connection_pool_size    = 10 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.console_delay_seconds   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.datastore_regex         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.host_ip                 = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.host_password           = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.host_port               = 443 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.host_username           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.insecure                = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.integration_bridge      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.maximum_objects         = 100 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.pbm_default_policy      = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.pbm_enabled             = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.pbm_wsdl_location       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.serial_port_proxy_uri   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.serial_port_service_uri = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.task_poll_interval      = 0.5 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.use_linked_clone        = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.vnc_keymap              = en-us {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.vnc_port                = 5900 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vmware.vnc_port_total          = 10000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.auth_schemes               = ['none'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.enabled                    = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.novncproxy_port            = 6080 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.vencrypt_ca_certs          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.vencrypt_client_cert       = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vnc.vencrypt_client_key        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.disable_rootwrap   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.enable_numa_live_migration = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.libvirt_disable_apic = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.client_socket_timeout     = 900 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.default_pool_size         = 1000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.keep_alive                = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.max_header_line           = 16384 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.ssl_ca_file               = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.ssl_cert_file             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.ssl_key_file              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.tcp_keepidle              = 600 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] zvm.ca_file                    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] zvm.cloud_connector_url        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] zvm.reachable_timeout          = 300 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.enforce_scope      = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.policy_default_rule = default {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.connection_string     = messaging:// {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.enabled               = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.es_doc_type           = notification {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.es_scroll_size        = 10000 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.es_scroll_time        = 2m {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.filter_error_trace    = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.hmac_keys             = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.sentinel_service_name = mymaster {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.socket_timeout        = 0.1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.trace_requests        = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler.trace_sqlalchemy      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler_jaeger.process_tags   = {} {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] profiler_otlp.service_name_prefix = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] remote_debug.host              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] remote_debug.port              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.auth_section        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.auth_type           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.cafile              = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.certfile            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.collect_timing      = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.connect_retries     = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.connect_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.endpoint_id         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.endpoint_override   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.insecure            = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.keyfile             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.max_version         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.min_version         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.region_name         = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.service_name        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.service_type        = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.split_loggers       = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.status_code_retries = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.status_code_retry_delay = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.timeout             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.valid_interfaces    = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_limit.version             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_reports.file_event_handler = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] oslo_reports.log_dir           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_ovs_privileged.group  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] vif_plug_ovs_privileged.user   = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_ovs.isolate_vif         = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] os_brick.lock_path             = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] privsep_osbrick.capabilities   = [21] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] privsep_osbrick.group          = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] privsep_osbrick.helper_command = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] privsep_osbrick.user           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] nova_sys_admin.group           = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] nova_sys_admin.helper_command  = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] nova_sys_admin.user            = None {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG oslo_service.service [None req-041a7f60-8c76-41d1-ae17-b57bf8e816c1 None None] ******************************************************************************** {{(pid=75215) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 11 01:25:08 user nova-compute[75215]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 11 01:25:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Connecting to libvirt: qemu:///system {{(pid=75215) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f406894ae90> {{(pid=75215) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 11 01:25:08 user nova-compute[75215]: libvirt:  error : internal error: could not initialize domain event timer
Nov 11 01:25:08 user nova-compute[75215]: WARNING nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 11 01:25:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f406894ae90> {{(pid=75215) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Starting native event thread {{(pid=75215) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Starting green dispatch thread {{(pid=75215) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 11 01:25:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Starting connection event dispatch thread {{(pid=75215) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 11 01:25:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Connection event '1' reason 'None'
Nov 11 01:25:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 11 01:25:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.mount [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Initialising _HostMountState generation 0 {{(pid=75215) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 11 01:25:15 user nova-compute[75215]: INFO nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host capabilities <capabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <host>
Nov 11 01:25:15 user nova-compute[75215]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 11 01:25:15 user nova-compute[75215]:     <cpu>
Nov 11 01:25:15 user nova-compute[75215]:       <arch>x86_64</arch>
Nov 11 01:25:15 user nova-compute[75215]:       <model>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <microcode version='1070'/>
Nov 11 01:25:15 user nova-compute[75215]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 11 01:25:15 user nova-compute[75215]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='osxsave'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='invtsc'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='rsba'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature name='skip-l1dfl-vmentry'/>
Nov 11 01:25:15 user nova-compute[75215]:       <pages unit='KiB' size='4'/>
Nov 11 01:25:15 user nova-compute[75215]:       <pages unit='KiB' size='2048'/>
Nov 11 01:25:15 user nova-compute[75215]:     </cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <power_management>
Nov 11 01:25:15 user nova-compute[75215]:       <suspend_mem/>
Nov 11 01:25:15 user nova-compute[75215]:       <suspend_disk/>
Nov 11 01:25:15 user nova-compute[75215]:       <suspend_hybrid/>
Nov 11 01:25:15 user nova-compute[75215]:     </power_management>
Nov 11 01:25:15 user nova-compute[75215]:     <iommu support='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <migration_features>
Nov 11 01:25:15 user nova-compute[75215]:       <live/>
Nov 11 01:25:15 user nova-compute[75215]:       <uri_transports>
Nov 11 01:25:15 user nova-compute[75215]:         <uri_transport>tcp</uri_transport>
Nov 11 01:25:15 user nova-compute[75215]:         <uri_transport>rdma</uri_transport>
Nov 11 01:25:15 user nova-compute[75215]:       </uri_transports>
Nov 11 01:25:15 user nova-compute[75215]:     </migration_features>
Nov 11 01:25:15 user nova-compute[75215]:     <topology>
Nov 11 01:25:15 user nova-compute[75215]:       <cells num='2'>
Nov 11 01:25:15 user nova-compute[75215]:         <cell id='0'>
Nov 11 01:25:15 user nova-compute[75215]:           <memory unit='KiB'>8140616</memory>
Nov 11 01:25:15 user nova-compute[75215]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 11 01:25:15 user nova-compute[75215]:           <pages unit='KiB' size='2048'>0</pages>
Nov 11 01:25:15 user nova-compute[75215]:           <distances>
Nov 11 01:25:15 user nova-compute[75215]:             <sibling id='0' value='10'/>
Nov 11 01:25:15 user nova-compute[75215]:             <sibling id='1' value='20'/>
Nov 11 01:25:15 user nova-compute[75215]:           </distances>
Nov 11 01:25:15 user nova-compute[75215]:           <cpus num='6'>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 11 01:25:15 user nova-compute[75215]:           </cpus>
Nov 11 01:25:15 user nova-compute[75215]:         </cell>
Nov 11 01:25:15 user nova-compute[75215]:         <cell id='1'>
Nov 11 01:25:15 user nova-compute[75215]:           <memory unit='KiB'>8255068</memory>
Nov 11 01:25:15 user nova-compute[75215]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 11 01:25:15 user nova-compute[75215]:           <pages unit='KiB' size='2048'>0</pages>
Nov 11 01:25:15 user nova-compute[75215]:           <distances>
Nov 11 01:25:15 user nova-compute[75215]:             <sibling id='0' value='20'/>
Nov 11 01:25:15 user nova-compute[75215]:             <sibling id='1' value='10'/>
Nov 11 01:25:15 user nova-compute[75215]:           </distances>
Nov 11 01:25:15 user nova-compute[75215]:           <cpus num='6'>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 11 01:25:15 user nova-compute[75215]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 11 01:25:15 user nova-compute[75215]:           </cpus>
Nov 11 01:25:15 user nova-compute[75215]:         </cell>
Nov 11 01:25:15 user nova-compute[75215]:       </cells>
Nov 11 01:25:15 user nova-compute[75215]:     </topology>
Nov 11 01:25:15 user nova-compute[75215]:     <cache>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 11 01:25:15 user nova-compute[75215]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 11 01:25:15 user nova-compute[75215]:     </cache>
Nov 11 01:25:15 user nova-compute[75215]:     <secmodel>
Nov 11 01:25:15 user nova-compute[75215]:       <model>apparmor</model>
Nov 11 01:25:15 user nova-compute[75215]:       <doi>0</doi>
Nov 11 01:25:15 user nova-compute[75215]:     </secmodel>
Nov 11 01:25:15 user nova-compute[75215]:     <secmodel>
Nov 11 01:25:15 user nova-compute[75215]:       <model>dac</model>
Nov 11 01:25:15 user nova-compute[75215]:       <doi>0</doi>
Nov 11 01:25:15 user nova-compute[75215]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 11 01:25:15 user nova-compute[75215]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 11 01:25:15 user nova-compute[75215]:     </secmodel>
Nov 11 01:25:15 user nova-compute[75215]:   </host>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='alpha'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>clipper</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='armv6l'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>integratorcp</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>borzoi</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>spitz</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>nuri</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>musca-b1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>versatileab</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>kzm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>musca-a</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>smdkc210</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sx1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>z2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>tosa</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>sabrelite</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>realview-eb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>n810</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>n800</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>versatilepb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>terrier</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mainstone</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>midway</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>musicpal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>microbit</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>cubieboard</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>verdex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>netduino2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>raspi2b</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>cheetah</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>highbank</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>akita</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>connex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>collie</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>raspi0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='armv7l'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>integratorcp</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>borzoi</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>spitz</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>nuri</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>musca-b1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>versatileab</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>kzm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>musca-a</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>smdkc210</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sx1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>z2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>tosa</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>sabrelite</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>realview-eb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>n810</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>n800</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>versatilepb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>terrier</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mainstone</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>midway</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>musicpal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>microbit</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>cubieboard</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>verdex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>netduino2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>raspi2b</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>cheetah</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>highbank</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>akita</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>connex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>collie</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>raspi0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='aarch64'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>integratorcp</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>borzoi</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>spitz</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>nuri</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>musca-b1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>versatileab</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>kzm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>musca-a</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>smdkc210</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sx1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>z2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>tosa</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>sabrelite</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>realview-eb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>n810</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>n800</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>versatilepb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>terrier</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mainstone</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>midway</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>musicpal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>microbit</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>cubieboard</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>verdex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>netduino2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>raspi3b</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>raspi2b</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>cheetah</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>highbank</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>akita</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>connex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>collie</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>raspi0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <acpi default='on' toggle='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='cris'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='i686'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>x-remote</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>isapc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>microvm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='kvm'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <pae/>
Nov 11 01:25:15 user nova-compute[75215]:       <nonpae/>
Nov 11 01:25:15 user nova-compute[75215]:       <acpi default='on' toggle='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:       <apic default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='m68k'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>an5206</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>q800</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>next-cube</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='microblaze'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='microblazeel'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='mips'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='16'>malta</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mipssim</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='mipsel'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='16'>malta</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mipssim</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='mips64'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='16'>malta</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mipssim</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>pica61</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>magnum</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='mips64el'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='16'>malta</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mipssim</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>pica61</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>magnum</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='16'>boston</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='ppc'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>g3beige</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mac99</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>ppce500</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>pegasos2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sam460ex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>bamboo</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>40p</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>ref405ep</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>taihu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='ppc64'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2048'>powernv9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>taihu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2048'>powernv10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>ppce500</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>40p</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>pegasos2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>bamboo</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>g3beige</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mac99</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sam460ex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>ref405ep</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2048'>powernv8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='ppc64le'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2048'>powernv9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>taihu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2048'>powernv10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>ppce500</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>40p</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>pegasos2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>bamboo</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>g3beige</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>mac99</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sam460ex</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>ref405ep</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2048'>powernv8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='riscv32'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='8'>spike</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>opentitan</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='5'>sifive_u</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sifive_e</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='8'>virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='riscv64'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='8'>spike</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='5'>sifive_u</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>shakti_c</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sifive_e</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='8'>virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='s390x'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='sh4'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>shix</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>r2d</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='sh4eb'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>shix</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>r2d</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='sparc'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>SS-5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>SS-20</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>LX</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>SS-4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>SS-10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>Voyager</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='sparc64'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sun4u</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>niagara</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>sun4v</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='x86_64'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>64</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>x-remote</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='1'>isapc</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>microvm</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='kvm'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <acpi default='on' toggle='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:       <apic default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='xtensa'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>sim</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>kc705</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>ml605</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>lx200</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>lx60</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]:   <guest>
Nov 11 01:25:15 user nova-compute[75215]:     <os_type>hvm</os_type>
Nov 11 01:25:15 user nova-compute[75215]:     <arch name='xtensaeb'>
Nov 11 01:25:15 user nova-compute[75215]:       <wordsize>32</wordsize>
Nov 11 01:25:15 user nova-compute[75215]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='4'>sim</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>kc705</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>ml605</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>virt</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>lx200</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>lx60</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 11 01:25:15 user nova-compute[75215]:       <domain type='qemu'/>
Nov 11 01:25:15 user nova-compute[75215]:     </arch>
Nov 11 01:25:15 user nova-compute[75215]:     <features>
Nov 11 01:25:15 user nova-compute[75215]:       <cpuselection/>
Nov 11 01:25:15 user nova-compute[75215]:       <deviceboot/>
Nov 11 01:25:15 user nova-compute[75215]:       <disksnapshot default='on' toggle='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     </features>
Nov 11 01:25:15 user nova-compute[75215]:   </guest>
Nov 11 01:25:15 user nova-compute[75215]: </capabilities>
Nov 11 01:25:15 user nova-compute[75215]: 
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 11 01:25:15 user nova-compute[75215]: <domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <path>/usr/bin/qemu-system-i386</path>
Nov 11 01:25:15 user nova-compute[75215]:   <domain>kvm</domain>
Nov 11 01:25:15 user nova-compute[75215]:   <machine>pc-i440fx-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:   <arch>i686</arch>
Nov 11 01:25:15 user nova-compute[75215]:   <vcpu max='255'/>
Nov 11 01:25:15 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:   <os supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='firmware'/>
Nov 11 01:25:15 user nova-compute[75215]:     <loader supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>rom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pflash</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='readonly'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='secure'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </loader>
Nov 11 01:25:15 user nova-compute[75215]:   </os>
Nov 11 01:25:15 user nova-compute[75215]:   <cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='lm'/>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>kvm64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>core2duo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Westmere-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Westmere</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Penryn</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G1</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Nehalem-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Conroe</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:   </cpu>
Nov 11 01:25:15 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='sourceType'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>file</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>anonymous</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>memfd</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:   </memoryBacking>
Nov 11 01:25:15 user nova-compute[75215]:   <devices>
Nov 11 01:25:15 user nova-compute[75215]:     <disk supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>disk</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cdrom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>floppy</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>lun</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='bus'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ide</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>fdc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sata</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </disk>
Nov 11 01:25:15 user nova-compute[75215]:     <graphics supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sdl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vnc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>spice</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egl-headless</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </graphics>
Nov 11 01:25:15 user nova-compute[75215]:     <video supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='modelType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cirrus</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vmvga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>qxl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>none</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>bochs</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ramfb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </video>
Nov 11 01:25:15 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='mode'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>subsystem</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>default</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>mandatory</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>requisite</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>optional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='subsysType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pci</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='capsType'/>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 11 01:25:15 user nova-compute[75215]:     </hostdev>
Nov 11 01:25:15 user nova-compute[75215]:     <rng supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>random</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egd</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>builtin</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </rng>
Nov 11 01:25:15 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='driverType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>path</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>handle</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtiofs</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </filesystem>
Nov 11 01:25:15 user nova-compute[75215]:     <tpm supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>passthrough</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>emulator</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </tpm>
Nov 11 01:25:15 user nova-compute[75215]:   </devices>
Nov 11 01:25:15 user nova-compute[75215]:   <features>
Nov 11 01:25:15 user nova-compute[75215]:     <gic supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <genid supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backup supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <sev supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:   </features>
Nov 11 01:25:15 user nova-compute[75215]: </domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 11 01:25:15 user nova-compute[75215]: <domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <path>/usr/bin/qemu-system-i386</path>
Nov 11 01:25:15 user nova-compute[75215]:   <domain>kvm</domain>
Nov 11 01:25:15 user nova-compute[75215]:   <machine>pc-q35-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:   <arch>i686</arch>
Nov 11 01:25:15 user nova-compute[75215]:   <vcpu max='288'/>
Nov 11 01:25:15 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:   <os supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='firmware'/>
Nov 11 01:25:15 user nova-compute[75215]:     <loader supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>rom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pflash</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='readonly'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='secure'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </loader>
Nov 11 01:25:15 user nova-compute[75215]:   </os>
Nov 11 01:25:15 user nova-compute[75215]:   <cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='lm'/>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>kvm64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>core2duo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Westmere-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Westmere</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Penryn</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G1</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Nehalem-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Conroe</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:   </cpu>
Nov 11 01:25:15 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='sourceType'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>file</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>anonymous</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>memfd</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:   </memoryBacking>
Nov 11 01:25:15 user nova-compute[75215]:   <devices>
Nov 11 01:25:15 user nova-compute[75215]:     <disk supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>disk</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cdrom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>floppy</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>lun</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='bus'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>fdc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sata</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </disk>
Nov 11 01:25:15 user nova-compute[75215]:     <graphics supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sdl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vnc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>spice</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egl-headless</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </graphics>
Nov 11 01:25:15 user nova-compute[75215]:     <video supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='modelType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cirrus</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vmvga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>qxl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>none</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>bochs</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ramfb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </video>
Nov 11 01:25:15 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='mode'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>subsystem</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>default</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>mandatory</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>requisite</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>optional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='subsysType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pci</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='capsType'/>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 11 01:25:15 user nova-compute[75215]:     </hostdev>
Nov 11 01:25:15 user nova-compute[75215]:     <rng supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>random</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egd</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>builtin</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </rng>
Nov 11 01:25:15 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='driverType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>path</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>handle</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtiofs</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </filesystem>
Nov 11 01:25:15 user nova-compute[75215]:     <tpm supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>passthrough</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>emulator</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </tpm>
Nov 11 01:25:15 user nova-compute[75215]:   </devices>
Nov 11 01:25:15 user nova-compute[75215]:   <features>
Nov 11 01:25:15 user nova-compute[75215]:     <gic supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <genid supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backup supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <sev supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:   </features>
Nov 11 01:25:15 user nova-compute[75215]: </domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 11 01:25:15 user nova-compute[75215]: <domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <path>/usr/bin/qemu-system-i386</path>
Nov 11 01:25:15 user nova-compute[75215]:   <domain>kvm</domain>
Nov 11 01:25:15 user nova-compute[75215]:   <machine>pc-i440fx-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:   <arch>i686</arch>
Nov 11 01:25:15 user nova-compute[75215]:   <vcpu max='255'/>
Nov 11 01:25:15 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:   <os supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='firmware'/>
Nov 11 01:25:15 user nova-compute[75215]:     <loader supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>rom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pflash</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='readonly'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='secure'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </loader>
Nov 11 01:25:15 user nova-compute[75215]:   </os>
Nov 11 01:25:15 user nova-compute[75215]:   <cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='lm'/>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>kvm64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>core2duo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Westmere-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Westmere</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Penryn</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G1</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Nehalem-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Conroe</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:   </cpu>
Nov 11 01:25:15 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='sourceType'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>file</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>anonymous</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>memfd</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:   </memoryBacking>
Nov 11 01:25:15 user nova-compute[75215]:   <devices>
Nov 11 01:25:15 user nova-compute[75215]:     <disk supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>disk</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cdrom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>floppy</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>lun</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='bus'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ide</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>fdc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sata</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </disk>
Nov 11 01:25:15 user nova-compute[75215]:     <graphics supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sdl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vnc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>spice</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egl-headless</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </graphics>
Nov 11 01:25:15 user nova-compute[75215]:     <video supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='modelType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cirrus</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vmvga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>qxl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>none</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>bochs</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ramfb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </video>
Nov 11 01:25:15 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='mode'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>subsystem</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>default</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>mandatory</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>requisite</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>optional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='subsysType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pci</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='capsType'/>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 11 01:25:15 user nova-compute[75215]:     </hostdev>
Nov 11 01:25:15 user nova-compute[75215]:     <rng supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>random</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egd</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>builtin</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </rng>
Nov 11 01:25:15 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='driverType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>path</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>handle</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtiofs</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </filesystem>
Nov 11 01:25:15 user nova-compute[75215]:     <tpm supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>passthrough</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>emulator</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </tpm>
Nov 11 01:25:15 user nova-compute[75215]:   </devices>
Nov 11 01:25:15 user nova-compute[75215]:   <features>
Nov 11 01:25:15 user nova-compute[75215]:     <gic supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <genid supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backup supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <sev supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:   </features>
Nov 11 01:25:15 user nova-compute[75215]: </domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 11 01:25:15 user nova-compute[75215]: <domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <path>/usr/bin/qemu-system-i386</path>
Nov 11 01:25:15 user nova-compute[75215]:   <domain>kvm</domain>
Nov 11 01:25:15 user nova-compute[75215]:   <machine>pc-q35-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:   <arch>i686</arch>
Nov 11 01:25:15 user nova-compute[75215]:   <vcpu max='288'/>
Nov 11 01:25:15 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:   <os supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='firmware'/>
Nov 11 01:25:15 user nova-compute[75215]:     <loader supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>rom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pflash</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='readonly'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='secure'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </loader>
Nov 11 01:25:15 user nova-compute[75215]:   </os>
Nov 11 01:25:15 user nova-compute[75215]:   <cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='lm'/>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>kvm64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>core2duo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Westmere-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Westmere</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Penryn</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G1</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Nehalem-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Conroe</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:   </cpu>
Nov 11 01:25:15 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='sourceType'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>file</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>anonymous</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>memfd</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:   </memoryBacking>
Nov 11 01:25:15 user nova-compute[75215]:   <devices>
Nov 11 01:25:15 user nova-compute[75215]:     <disk supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>disk</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cdrom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>floppy</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>lun</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='bus'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>fdc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sata</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </disk>
Nov 11 01:25:15 user nova-compute[75215]:     <graphics supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sdl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vnc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>spice</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egl-headless</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </graphics>
Nov 11 01:25:15 user nova-compute[75215]:     <video supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='modelType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cirrus</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vmvga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>qxl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>none</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>bochs</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ramfb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </video>
Nov 11 01:25:15 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='mode'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>subsystem</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>default</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>mandatory</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>requisite</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>optional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='subsysType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pci</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='capsType'/>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 11 01:25:15 user nova-compute[75215]:     </hostdev>
Nov 11 01:25:15 user nova-compute[75215]:     <rng supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>random</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egd</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>builtin</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </rng>
Nov 11 01:25:15 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='driverType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>path</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>handle</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtiofs</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </filesystem>
Nov 11 01:25:15 user nova-compute[75215]:     <tpm supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>passthrough</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>emulator</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </tpm>
Nov 11 01:25:15 user nova-compute[75215]:   </devices>
Nov 11 01:25:15 user nova-compute[75215]:   <features>
Nov 11 01:25:15 user nova-compute[75215]:     <gic supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <genid supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backup supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <sev supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:   </features>
Nov 11 01:25:15 user nova-compute[75215]: </domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 11 01:25:15 user nova-compute[75215]: <domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 11 01:25:15 user nova-compute[75215]:   <domain>kvm</domain>
Nov 11 01:25:15 user nova-compute[75215]:   <machine>pc-i440fx-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 11 01:25:15 user nova-compute[75215]:   <vcpu max='255'/>
Nov 11 01:25:15 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:   <os supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='firmware'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>efi</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:     <loader supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>rom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pflash</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='readonly'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='secure'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </loader>
Nov 11 01:25:15 user nova-compute[75215]:   </os>
Nov 11 01:25:15 user nova-compute[75215]:   <cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='invtsc'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='rsba'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pschange-mc-no'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>core2duo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Westmere-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Westmere</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Penryn</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Opteron_G1</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Conroe</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:   </cpu>
Nov 11 01:25:15 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='sourceType'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>file</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>anonymous</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>memfd</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:   </memoryBacking>
Nov 11 01:25:15 user nova-compute[75215]:   <devices>
Nov 11 01:25:15 user nova-compute[75215]:     <disk supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>disk</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cdrom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>floppy</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>lun</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='bus'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ide</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>fdc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sata</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </disk>
Nov 11 01:25:15 user nova-compute[75215]:     <graphics supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sdl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vnc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>spice</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egl-headless</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </graphics>
Nov 11 01:25:15 user nova-compute[75215]:     <video supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='modelType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cirrus</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vmvga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>qxl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>none</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>bochs</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ramfb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </video>
Nov 11 01:25:15 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='mode'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>subsystem</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>default</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>mandatory</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>requisite</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>optional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='subsysType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pci</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='capsType'/>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 11 01:25:15 user nova-compute[75215]:     </hostdev>
Nov 11 01:25:15 user nova-compute[75215]:     <rng supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>random</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egd</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>builtin</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </rng>
Nov 11 01:25:15 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='driverType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>path</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>handle</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtiofs</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </filesystem>
Nov 11 01:25:15 user nova-compute[75215]:     <tpm supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>passthrough</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>emulator</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </tpm>
Nov 11 01:25:15 user nova-compute[75215]:   </devices>
Nov 11 01:25:15 user nova-compute[75215]:   <features>
Nov 11 01:25:15 user nova-compute[75215]:     <gic supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <genid supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backup supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <sev supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:   </features>
Nov 11 01:25:15 user nova-compute[75215]: </domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 11 01:25:15 user nova-compute[75215]: <domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 11 01:25:15 user nova-compute[75215]:   <domain>kvm</domain>
Nov 11 01:25:15 user nova-compute[75215]:   <machine>pc-q35-6.2</machine>
Nov 11 01:25:15 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 11 01:25:15 user nova-compute[75215]:   <vcpu max='288'/>
Nov 11 01:25:15 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:   <os supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='firmware'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>efi</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:     <loader supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>rom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pflash</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='readonly'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='secure'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </loader>
Nov 11 01:25:15 user nova-compute[75215]:   </os>
Nov 11 01:25:15 user nova-compute[75215]:   <cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='invtsc'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='rsba'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pschange-mc-no'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>core2duo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Westmere-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Westmere</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Penryn</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Opteron_G1</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Conroe</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:   </cpu>
Nov 11 01:25:15 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='sourceType'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>file</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>anonymous</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>memfd</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:   </memoryBacking>
Nov 11 01:25:15 user nova-compute[75215]:   <devices>
Nov 11 01:25:15 user nova-compute[75215]:     <disk supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>disk</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cdrom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>floppy</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>lun</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='bus'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>fdc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sata</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </disk>
Nov 11 01:25:15 user nova-compute[75215]:     <graphics supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sdl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vnc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>spice</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egl-headless</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </graphics>
Nov 11 01:25:15 user nova-compute[75215]:     <video supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='modelType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cirrus</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vmvga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>qxl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>none</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>bochs</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ramfb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </video>
Nov 11 01:25:15 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='mode'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>subsystem</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>default</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>mandatory</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>requisite</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>optional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='subsysType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pci</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='capsType'/>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 11 01:25:15 user nova-compute[75215]:     </hostdev>
Nov 11 01:25:15 user nova-compute[75215]:     <rng supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>random</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egd</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>builtin</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </rng>
Nov 11 01:25:15 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='driverType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>path</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>handle</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtiofs</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </filesystem>
Nov 11 01:25:15 user nova-compute[75215]:     <tpm supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>passthrough</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>emulator</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </tpm>
Nov 11 01:25:15 user nova-compute[75215]:   </devices>
Nov 11 01:25:15 user nova-compute[75215]:   <features>
Nov 11 01:25:15 user nova-compute[75215]:     <gic supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <genid supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backup supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <sev supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:   </features>
Nov 11 01:25:15 user nova-compute[75215]: </domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 11 01:25:15 user nova-compute[75215]: <domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 11 01:25:15 user nova-compute[75215]:   <domain>kvm</domain>
Nov 11 01:25:15 user nova-compute[75215]:   <machine>pc-i440fx-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 11 01:25:15 user nova-compute[75215]:   <vcpu max='255'/>
Nov 11 01:25:15 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:   <os supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='firmware'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>efi</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:     <loader supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>rom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pflash</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='readonly'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='secure'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </loader>
Nov 11 01:25:15 user nova-compute[75215]:   </os>
Nov 11 01:25:15 user nova-compute[75215]:   <cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='invtsc'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='rsba'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pschange-mc-no'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>core2duo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Westmere-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Westmere</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Penryn</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Opteron_G1</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Conroe</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:   </cpu>
Nov 11 01:25:15 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='sourceType'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>file</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>anonymous</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>memfd</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:   </memoryBacking>
Nov 11 01:25:15 user nova-compute[75215]:   <devices>
Nov 11 01:25:15 user nova-compute[75215]:     <disk supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>disk</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cdrom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>floppy</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>lun</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='bus'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ide</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>fdc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sata</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </disk>
Nov 11 01:25:15 user nova-compute[75215]:     <graphics supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sdl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vnc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>spice</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egl-headless</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </graphics>
Nov 11 01:25:15 user nova-compute[75215]:     <video supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='modelType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cirrus</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vmvga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>qxl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>none</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>bochs</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ramfb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </video>
Nov 11 01:25:15 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='mode'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>subsystem</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>default</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>mandatory</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>requisite</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>optional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='subsysType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pci</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='capsType'/>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 11 01:25:15 user nova-compute[75215]:     </hostdev>
Nov 11 01:25:15 user nova-compute[75215]:     <rng supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>random</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egd</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>builtin</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </rng>
Nov 11 01:25:15 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='driverType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>path</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>handle</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtiofs</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </filesystem>
Nov 11 01:25:15 user nova-compute[75215]:     <tpm supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>passthrough</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>emulator</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </tpm>
Nov 11 01:25:15 user nova-compute[75215]:   </devices>
Nov 11 01:25:15 user nova-compute[75215]:   <features>
Nov 11 01:25:15 user nova-compute[75215]:     <gic supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <genid supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backup supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <sev supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:   </features>
Nov 11 01:25:15 user nova-compute[75215]: </domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 11 01:25:15 user nova-compute[75215]: <domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 11 01:25:15 user nova-compute[75215]:   <domain>kvm</domain>
Nov 11 01:25:15 user nova-compute[75215]:   <machine>pc-q35-jammy</machine>
Nov 11 01:25:15 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 11 01:25:15 user nova-compute[75215]:   <vcpu max='288'/>
Nov 11 01:25:15 user nova-compute[75215]:   <iothreads supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:   <os supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='firmware'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>efi</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:     <loader supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>rom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pflash</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='readonly'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='secure'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>yes</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>no</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </loader>
Nov 11 01:25:15 user nova-compute[75215]:   </os>
Nov 11 01:25:15 user nova-compute[75215]:   <cpu>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-passthrough' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='hostPassthroughMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='maximum' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='maximumMigratable'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>on</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>off</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='host-model' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <vendor>Intel</vendor>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ss'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='vmx'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pcid'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='hypervisor'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arat'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='tsc_adjust'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='umip'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='md-clear'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='arch-capabilities'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='invtsc'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibpb'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='ibrs'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-stibp'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='amd-ssbd'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='rsba'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='require' name='pschange-mc-no'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='erms'/>
Nov 11 01:25:15 user nova-compute[75215]:       <feature policy='disable' name='xsaveopt'/>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:     <mode name='custom' supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>qemu64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>qemu32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>phenom</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>pentium</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>n270</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm64</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>kvm32</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>coreduo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>core2duo</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>athlon</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Westmere-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Westmere</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Snowridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Skylake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>SandyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Penryn</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G5</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G4</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G3</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Opteron_G2</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Opteron_G1</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>IvyBridge</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Icelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Haswell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Rome</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-Milan</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC-IBPB</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>EPYC</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Dhyana</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cooperlake</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>Conroe</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Cascadelake-Server</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-noTSX</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell-IBRS</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='no'>Broadwell</model>
Nov 11 01:25:15 user nova-compute[75215]:       <model usable='yes'>486</model>
Nov 11 01:25:15 user nova-compute[75215]:     </mode>
Nov 11 01:25:15 user nova-compute[75215]:   </cpu>
Nov 11 01:25:15 user nova-compute[75215]:   <memoryBacking supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:     <enum name='sourceType'>
Nov 11 01:25:15 user nova-compute[75215]:       <value>file</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>anonymous</value>
Nov 11 01:25:15 user nova-compute[75215]:       <value>memfd</value>
Nov 11 01:25:15 user nova-compute[75215]:     </enum>
Nov 11 01:25:15 user nova-compute[75215]:   </memoryBacking>
Nov 11 01:25:15 user nova-compute[75215]:   <devices>
Nov 11 01:25:15 user nova-compute[75215]:     <disk supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='diskDevice'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>disk</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cdrom</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>floppy</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>lun</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='bus'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>fdc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sata</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </disk>
Nov 11 01:25:15 user nova-compute[75215]:     <graphics supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='type'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>sdl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vnc</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>spice</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egl-headless</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </graphics>
Nov 11 01:25:15 user nova-compute[75215]:     <video supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='modelType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>cirrus</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>vmvga</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>qxl</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>none</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>bochs</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>ramfb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </video>
Nov 11 01:25:15 user nova-compute[75215]:     <hostdev supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='mode'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>subsystem</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='startupPolicy'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>default</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>mandatory</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>requisite</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>optional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='subsysType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>usb</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>pci</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>scsi</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='capsType'/>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='pciBackend'/>
Nov 11 01:25:15 user nova-compute[75215]:     </hostdev>
Nov 11 01:25:15 user nova-compute[75215]:     <rng supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtio-non-transitional</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>random</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>egd</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>builtin</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </rng>
Nov 11 01:25:15 user nova-compute[75215]:     <filesystem supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='driverType'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>path</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>handle</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>virtiofs</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </filesystem>
Nov 11 01:25:15 user nova-compute[75215]:     <tpm supported='yes'>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='model'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-tis</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>tpm-crb</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:       <enum name='backendModel'>
Nov 11 01:25:15 user nova-compute[75215]:         <value>passthrough</value>
Nov 11 01:25:15 user nova-compute[75215]:         <value>emulator</value>
Nov 11 01:25:15 user nova-compute[75215]:       </enum>
Nov 11 01:25:15 user nova-compute[75215]:     </tpm>
Nov 11 01:25:15 user nova-compute[75215]:   </devices>
Nov 11 01:25:15 user nova-compute[75215]:   <features>
Nov 11 01:25:15 user nova-compute[75215]:     <gic supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:     <vmcoreinfo supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <genid supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backingStoreInput supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <backup supported='yes'/>
Nov 11 01:25:15 user nova-compute[75215]:     <sev supported='no'/>
Nov 11 01:25:15 user nova-compute[75215]:   </features>
Nov 11 01:25:15 user nova-compute[75215]: </domainCapabilities>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75215) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75215) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Checking secure boot support for host arch (x86_64) {{(pid=75215) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Checking secure boot support for host arch (x86_64) {{(pid=75215) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Checking secure boot support for host arch (x86_64) {{(pid=75215) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 11 01:25:15 user nova-compute[75215]: INFO nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Secure Boot support detected
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] cpu compare xml: <cpu match="exact">
Nov 11 01:25:15 user nova-compute[75215]:   <model>Nehalem</model>
Nov 11 01:25:15 user nova-compute[75215]: </cpu>
Nov 11 01:25:15 user nova-compute[75215]:  {{(pid=75215) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 11 01:25:15 user nova-compute[75215]: INFO nova.virt.node [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Generated node identity d4069c05-e0f6-4cda-a48f-ad6318f28710
Nov 11 01:25:15 user nova-compute[75215]: INFO nova.virt.node [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Wrote node identity d4069c05-e0f6-4cda-a48f-ad6318f28710 to /opt/stack/data/nova/compute_id
Nov 11 01:25:15 user nova-compute[75215]: WARNING nova.compute.manager [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Compute nodes ['d4069c05-e0f6-4cda-a48f-ad6318f28710'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 11 01:25:15 user nova-compute[75215]: INFO nova.compute.manager [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 11 01:25:15 user nova-compute[75215]: WARNING nova.compute.manager [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 11 01:25:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:25:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:25:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:25:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Hypervisor/Node resource view: name=user free_ram=10986MB free_disk=26.24895477294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:25:16 user nova-compute[75215]: WARNING nova.compute.resource_tracker [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] No compute node record for user:d4069c05-e0f6-4cda-a48f-ad6318f28710: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d4069c05-e0f6-4cda-a48f-ad6318f28710 could not be found.
Nov 11 01:25:16 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Compute node record created for user:user with uuid: d4069c05-e0f6-4cda-a48f-ad6318f28710
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:25:16 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] [req-a088c41c-cd85-444d-bb63-3b60d3f9d3d1] Created resource provider record via placement API for resource provider with UUID d4069c05-e0f6-4cda-a48f-ad6318f28710 and name user.
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75215) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 11 01:25:16 user nova-compute[75215]: INFO nova.virt.libvirt.host [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] kernel doesn't support AMD SEV
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Libvirt baseline CPU <cpu>
Nov 11 01:25:16 user nova-compute[75215]:   <arch>x86_64</arch>
Nov 11 01:25:16 user nova-compute[75215]:   <model>Nehalem</model>
Nov 11 01:25:16 user nova-compute[75215]:   <vendor>Intel</vendor>
Nov 11 01:25:16 user nova-compute[75215]:   <topology sockets="6" cores="1" threads="1"/>
Nov 11 01:25:16 user nova-compute[75215]: </cpu>
Nov 11 01:25:16 user nova-compute[75215]:  {{(pid=75215) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Updated inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Updating resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 generation from 0 to 1 during operation: update_inventory {{(pid=75215) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Updating resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 generation from 1 to 2 during operation: update_traits {{(pid=75215) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.service [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Creating RPC server for service compute {{(pid=75215) start /opt/stack/nova/nova/service.py:182}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.service [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] Join ServiceGroup membership for this service compute {{(pid=75215) start /opt/stack/nova/nova/service.py:199}}
Nov 11 01:25:16 user nova-compute[75215]: DEBUG nova.servicegroup.drivers.db [None req-fe2d47e8-36fd-435c-99e4-bfbe7ac438cc None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75215) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 11 01:25:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:25:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:26:07 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:26:07 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=10444MB free_disk=26.152782440185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:26:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:27:07 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:27:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:27:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:27:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=10396MB free_disk=26.21735382080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:27:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:27:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:28:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:28:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=10385MB free_disk=25.969757080078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:28:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:28:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:28:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:29:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=9735MB free_disk=25.99896240234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:29:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:29:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:29:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 01:29:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:29:23 user nova-compute[75215]: INFO nova.compute.claims [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Claim successful on node user
Nov 11 01:29:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:23 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.147s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:29:24 user nova-compute[75215]: INFO nova.compute.claims [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Claim successful on node user
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:29:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:29:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Creating image(s)
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "/opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "/opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "/opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:29:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:24 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:29:24 user nova-compute[75215]: INFO nova.compute.claims [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Claim successful on node user
Nov 11 01:29:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:29:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Creating image(s)
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "/opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "/opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "/opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.policy [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '561ad55121d44be1ab7971a495b9347f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32564a70b861419eaefcb97cd327088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.policy [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55650e69ce924b388eb12cb397127576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001c51cb81da454b931d9ede62e34564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.virt.images [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ff07f7e9-c859-41fd-adb3-c436d43c7526 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137.part /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137.part /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137.converted" returned: 0 in 0.366s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.835s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:29:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.166s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:25 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfo36c_ot/privsep.sock']
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.623s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:25 user sudo[84587]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfo36c_ot/privsep.sock
Nov 11 01:29:25 user sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:29:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Creating image(s)
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "/opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "/opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:25 user nova-compute[75215]: DEBUG nova.policy [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b46b01a4376441879b862458245e7776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fd9bc069854266adfdea2c19670a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:29:27 user sudo[84587]: pam_unix(sudo:session): session closed for user root
Nov 11 01:29:27 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Spawned new privsep daemon via rootwrap
Nov 11 01:29:27 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 11 01:29:27 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 11 01:29:27 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 11 01:29:27 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84592
Nov 11 01:29:27 user nova-compute[75215]: WARNING oslo_privsep.priv_context [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] privsep daemon already running
Nov 11 01:29:27 user nova-compute[75215]: WARNING oslo_privsep.priv_context [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] privsep daemon already running
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Successfully created port: 5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.257s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.162s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk 1073741824" returned: 0 in 0.048s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.213s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:29:27 user nova-compute[75215]: INFO nova.compute.claims [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Claim successful on node user
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.166s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk 1073741824" returned: 0 in 0.049s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.479s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Cannot resize image /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Ensure instance console log exists: /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.235s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk 1073741824" returned: 0 in 0.051s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Cannot resize image /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Ensure instance console log exists: /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:29:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:29:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Creating image(s)
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Successfully created port: eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Cannot resize image /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Ensure instance console log exists: /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG nova.policy [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '285cd483fbdc4e4faec7a1bbd414ca7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71c4317ced540a1a841f41cb9929b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk 1073741824" returned: 0 in 0.043s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Successfully created port: 2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "ad403c50-a8fe-442f-9189-0a6925580739" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Cannot resize image /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Ensure instance console log exists: /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Successfully updated port: 5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "refresh_cache-fb579a71-869d-41ce-9572-4f87a11378fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquired lock "refresh_cache-fb579a71-869d-41ce-9572-4f87a11378fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:29:29 user nova-compute[75215]: INFO nova.compute.claims [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Claim successful on node user
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-0a30f437-3ca9-4e68-9986-63cb57dc56db req-1fbd406b-fe15-48a8-a77a-9923d289a33b service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received event network-changed-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-0a30f437-3ca9-4e68-9986-63cb57dc56db req-1fbd406b-fe15-48a8-a77a-9923d289a33b service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Refreshing instance network info cache due to event network-changed-5539d217-03db-4412-9028-cb341052c5dc. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a30f437-3ca9-4e68-9986-63cb57dc56db req-1fbd406b-fe15-48a8-a77a-9923d289a33b service nova] Acquiring lock "refresh_cache-fb579a71-869d-41ce-9572-4f87a11378fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:29:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:29:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:29:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Creating image(s)
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "/opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "/opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.policy [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44e25bace5db43638b4eedfeb9215e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6fb80bd889f488bbfa25060dca25bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.159s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk 1073741824" returned: 0 in 0.038s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Updating instance_info_cache with network_info: [{"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Cannot resize image /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Ensure instance console log exists: /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Releasing lock "refresh_cache-fb579a71-869d-41ce-9572-4f87a11378fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Instance network_info: |[{"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a30f437-3ca9-4e68-9986-63cb57dc56db req-1fbd406b-fe15-48a8-a77a-9923d289a33b service nova] Acquired lock "refresh_cache-fb579a71-869d-41ce-9572-4f87a11378fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.network.neutron [req-0a30f437-3ca9-4e68-9986-63cb57dc56db req-1fbd406b-fe15-48a8-a77a-9923d289a33b service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Refreshing network info cache for port 5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Start _get_guest_xml network_info=[{"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:29:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2082431397',display_name='tempest-DeleteServersTestJSON-server-2082431397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2082431397',id=3,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59fd9bc069854266adfdea2c19670a37',ramdisk_id='',reservation_id='r-xj6lmple',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-796840098',owner_user_name='tempest-DeleteServersTestJSON-796840098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:26Z,user_data=None,user_id='b46b01a4376441879b862458245e7776',uuid=fb579a71-869d-41ce-9572-4f87a11378fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Converting VIF {"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:99,bridge_name='br-int',has_traffic_filtering=True,id=5539d217-03db-4412-9028-cb341052c5dc,network=Network(6c9d6ef4-3d07-4cb5-9ae3-bff34d730960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5539d217-03') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lazy-loading 'pci_devices' on Instance uuid fb579a71-869d-41ce-9572-4f87a11378fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:29:30 user nova-compute[75215]:   <uuid>fb579a71-869d-41ce-9572-4f87a11378fd</uuid>
Nov 11 01:29:30 user nova-compute[75215]:   <name>instance-00000003</name>
Nov 11 01:29:30 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:29:30 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:29:30 user nova-compute[75215]:   <metadata>
Nov 11 01:29:30 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:29:30 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:29:30 user nova-compute[75215]:       <nova:name>tempest-DeleteServersTestJSON-server-2082431397</nova:name>
Nov 11 01:29:30 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:29:30</nova:creationTime>
Nov 11 01:29:30 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:29:30 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:29:30 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:29:30 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:29:30 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:29:30 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:29:30 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:29:30 user nova-compute[75215]:       <nova:owner>
Nov 11 01:29:30 user nova-compute[75215]:         <nova:user uuid="b46b01a4376441879b862458245e7776">tempest-DeleteServersTestJSON-796840098-project-member</nova:user>
Nov 11 01:29:30 user nova-compute[75215]:         <nova:project uuid="59fd9bc069854266adfdea2c19670a37">tempest-DeleteServersTestJSON-796840098</nova:project>
Nov 11 01:29:30 user nova-compute[75215]:       </nova:owner>
Nov 11 01:29:30 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:29:30 user nova-compute[75215]:       <nova:ports>
Nov 11 01:29:30 user nova-compute[75215]:         <nova:port uuid="5539d217-03db-4412-9028-cb341052c5dc">
Nov 11 01:29:30 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 01:29:30 user nova-compute[75215]:         </nova:port>
Nov 11 01:29:30 user nova-compute[75215]:       </nova:ports>
Nov 11 01:29:30 user nova-compute[75215]:     </nova:instance>
Nov 11 01:29:30 user nova-compute[75215]:   </metadata>
Nov 11 01:29:30 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:29:30 user nova-compute[75215]:     <system>
Nov 11 01:29:30 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:29:30 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:29:30 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:29:30 user nova-compute[75215]:       <entry name="serial">fb579a71-869d-41ce-9572-4f87a11378fd</entry>
Nov 11 01:29:30 user nova-compute[75215]:       <entry name="uuid">fb579a71-869d-41ce-9572-4f87a11378fd</entry>
Nov 11 01:29:30 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:29:30 user nova-compute[75215]:     </system>
Nov 11 01:29:30 user nova-compute[75215]:   </sysinfo>
Nov 11 01:29:30 user nova-compute[75215]:   <os>
Nov 11 01:29:30 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:29:30 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:29:30 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:29:30 user nova-compute[75215]:   </os>
Nov 11 01:29:30 user nova-compute[75215]:   <features>
Nov 11 01:29:30 user nova-compute[75215]:     <acpi/>
Nov 11 01:29:30 user nova-compute[75215]:     <apic/>
Nov 11 01:29:30 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:29:30 user nova-compute[75215]:   </features>
Nov 11 01:29:30 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:29:30 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:29:30 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:29:30 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:29:30 user nova-compute[75215]:   </clock>
Nov 11 01:29:30 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:29:30 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:29:30 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:29:30 user nova-compute[75215]:   </cpu>
Nov 11 01:29:30 user nova-compute[75215]:   <devices>
Nov 11 01:29:30 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:29:30 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:29:30 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk"/>
Nov 11 01:29:30 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:29:30 user nova-compute[75215]:     </disk>
Nov 11 01:29:30 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:29:30 user nova-compute[75215]:       <mac address="fa:16:3e:32:d4:99"/>
Nov 11 01:29:30 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:30 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:29:30 user nova-compute[75215]:       <target dev="tap5539d217-03"/>
Nov 11 01:29:30 user nova-compute[75215]:     </interface>
Nov 11 01:29:30 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:29:30 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/console.log" append="off"/>
Nov 11 01:29:30 user nova-compute[75215]:     </serial>
Nov 11 01:29:30 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:29:30 user nova-compute[75215]:     <video>
Nov 11 01:29:30 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:30 user nova-compute[75215]:     </video>
Nov 11 01:29:30 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:29:30 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:29:30 user nova-compute[75215]:     </rng>
Nov 11 01:29:30 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:29:30 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:29:30 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:29:30 user nova-compute[75215]:     </memballoon>
Nov 11 01:29:30 user nova-compute[75215]:   </devices>
Nov 11 01:29:30 user nova-compute[75215]: </domain>
Nov 11 01:29:30 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2082431397',display_name='tempest-DeleteServersTestJSON-server-2082431397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2082431397',id=3,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59fd9bc069854266adfdea2c19670a37',ramdisk_id='',reservation_id='r-xj6lmple',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-796840098',owner_user_name='tempest-DeleteServersTestJSON-796840098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:26Z,user_data=None,user_id='b46b01a4376441879b862458245e7776',uuid=fb579a71-869d-41ce-9572-4f87a11378fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Converting VIF {"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:99,bridge_name='br-int',has_traffic_filtering=True,id=5539d217-03db-4412-9028-cb341052c5dc,network=Network(6c9d6ef4-3d07-4cb5-9ae3-bff34d730960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5539d217-03') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:30 user nova-compute[75215]: DEBUG os_vif [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:99,bridge_name='br-int',has_traffic_filtering=True,id=5539d217-03db-4412-9028-cb341052c5dc,network=Network(6c9d6ef4-3d07-4cb5-9ae3-bff34d730960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5539d217-03') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Created schema index Interface.name {{(pid=75215) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Created schema index Port.name {{(pid=75215) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Created schema index Bridge.name {{(pid=75215) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [POLLOUT] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec5939c9-afd0-5676-98e4-c649d1a3e7ba', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:31 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmppccda_wb/privsep.sock']
Nov 11 01:29:31 user sudo[84680]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmppccda_wb/privsep.sock
Nov 11 01:29:31 user sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Successfully created port: 9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Successfully updated port: eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquired lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-0a30f437-3ca9-4e68-9986-63cb57dc56db req-1fbd406b-fe15-48a8-a77a-9923d289a33b service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Updated VIF entry in instance network info cache for port 5539d217-03db-4412-9028-cb341052c5dc. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-0a30f437-3ca9-4e68-9986-63cb57dc56db req-1fbd406b-fe15-48a8-a77a-9923d289a33b service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Updating instance_info_cache with network_info: [{"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0a30f437-3ca9-4e68-9986-63cb57dc56db req-1fbd406b-fe15-48a8-a77a-9923d289a33b service nova] Releasing lock "refresh_cache-fb579a71-869d-41ce-9572-4f87a11378fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:32 user sudo[84680]: pam_unix(sudo:session): session closed for user root
Nov 11 01:29:32 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Spawned new privsep daemon via rootwrap
Nov 11 01:29:32 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 11 01:29:32 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 11 01:29:32 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 11 01:29:32 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84693
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Successfully updated port: 2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquired lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-15157633-ee87-4666-8d15-a9520cd128a3 req-52c1276d-455b-4607-bdf1-a9de0d4f1cf5 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received event network-changed-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-15157633-ee87-4666-8d15-a9520cd128a3 req-52c1276d-455b-4607-bdf1-a9de0d4f1cf5 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Refreshing instance network info cache due to event network-changed-eeda3b00-3677-4dd4-bad3-9a7439540308. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15157633-ee87-4666-8d15-a9520cd128a3 req-52c1276d-455b-4607-bdf1-a9de0d4f1cf5 service nova] Acquiring lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Successfully created port: 544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5539d217-03, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5539d217-03, col_values=(('qos', UUID('8f38bef8-4c43-4929-b834-1bf01e8aa6c0')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5539d217-03, col_values=(('external_ids', {'iface-id': '5539d217-03db-4412-9028-cb341052c5dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:d4:99', 'vm-uuid': 'fb579a71-869d-41ce-9572-4f87a11378fd'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:33 user nova-compute[75215]: INFO os_vif [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:99,bridge_name='br-int',has_traffic_filtering=True,id=5539d217-03db-4412-9028-cb341052c5dc,network=Network(6c9d6ef4-3d07-4cb5-9ae3-bff34d730960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5539d217-03')
Nov 11 01:29:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] No VIF found with MAC fa:16:3e:32:d4:99, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updating instance_info_cache with network_info: [{"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Releasing lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Instance network_info: |[{"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15157633-ee87-4666-8d15-a9520cd128a3 req-52c1276d-455b-4607-bdf1-a9de0d4f1cf5 service nova] Acquired lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-15157633-ee87-4666-8d15-a9520cd128a3 req-52c1276d-455b-4607-bdf1-a9de0d4f1cf5 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Refreshing network info cache for port eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Start _get_guest_xml network_info=[{"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-129843831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-129843831',id=1,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-9q8yhegy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:24Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=330defc6-9b43-4f1e-9a76-94b23750e1b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:4c:95,bridge_name='br-int',has_traffic_filtering=True,id=eeda3b00-3677-4dd4-bad3-9a7439540308,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeda3b00-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'pci_devices' on Instance uuid 330defc6-9b43-4f1e-9a76-94b23750e1b0 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updating instance_info_cache with network_info: [{"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:29:34 user nova-compute[75215]:   <uuid>330defc6-9b43-4f1e-9a76-94b23750e1b0</uuid>
Nov 11 01:29:34 user nova-compute[75215]:   <name>instance-00000001</name>
Nov 11 01:29:34 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:29:34 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:29:34 user nova-compute[75215]:   <metadata>
Nov 11 01:29:34 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:29:34 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-129843831</nova:name>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:29:34</nova:creationTime>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:29:34 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:29:34 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:owner>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:user uuid="561ad55121d44be1ab7971a495b9347f">tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member</nova:user>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:project uuid="32564a70b861419eaefcb97cd327088d">tempest-ServerBootFromVolumeStableRescueTest-1327607516</nova:project>
Nov 11 01:29:34 user nova-compute[75215]:       </nova:owner>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:ports>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:port uuid="eeda3b00-3677-4dd4-bad3-9a7439540308">
Nov 11 01:29:34 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:29:34 user nova-compute[75215]:         </nova:port>
Nov 11 01:29:34 user nova-compute[75215]:       </nova:ports>
Nov 11 01:29:34 user nova-compute[75215]:     </nova:instance>
Nov 11 01:29:34 user nova-compute[75215]:   </metadata>
Nov 11 01:29:34 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:29:34 user nova-compute[75215]:     <system>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="serial">330defc6-9b43-4f1e-9a76-94b23750e1b0</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="uuid">330defc6-9b43-4f1e-9a76-94b23750e1b0</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:29:34 user nova-compute[75215]:     </system>
Nov 11 01:29:34 user nova-compute[75215]:   </sysinfo>
Nov 11 01:29:34 user nova-compute[75215]:   <os>
Nov 11 01:29:34 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:29:34 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:29:34 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:29:34 user nova-compute[75215]:   </os>
Nov 11 01:29:34 user nova-compute[75215]:   <features>
Nov 11 01:29:34 user nova-compute[75215]:     <acpi/>
Nov 11 01:29:34 user nova-compute[75215]:     <apic/>
Nov 11 01:29:34 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:29:34 user nova-compute[75215]:   </features>
Nov 11 01:29:34 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:29:34 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:29:34 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:29:34 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:29:34 user nova-compute[75215]:   </clock>
Nov 11 01:29:34 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:29:34 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:29:34 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:29:34 user nova-compute[75215]:   </cpu>
Nov 11 01:29:34 user nova-compute[75215]:   <devices>
Nov 11 01:29:34 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:29:34 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:29:34 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk"/>
Nov 11 01:29:34 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:29:34 user nova-compute[75215]:     </disk>
Nov 11 01:29:34 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:29:34 user nova-compute[75215]:       <mac address="fa:16:3e:44:4c:95"/>
Nov 11 01:29:34 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:34 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:29:34 user nova-compute[75215]:       <target dev="tapeeda3b00-36"/>
Nov 11 01:29:34 user nova-compute[75215]:     </interface>
Nov 11 01:29:34 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:29:34 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/console.log" append="off"/>
Nov 11 01:29:34 user nova-compute[75215]:     </serial>
Nov 11 01:29:34 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:29:34 user nova-compute[75215]:     <video>
Nov 11 01:29:34 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:34 user nova-compute[75215]:     </video>
Nov 11 01:29:34 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:29:34 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:29:34 user nova-compute[75215]:     </rng>
Nov 11 01:29:34 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:29:34 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:29:34 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:29:34 user nova-compute[75215]:     </memballoon>
Nov 11 01:29:34 user nova-compute[75215]:   </devices>
Nov 11 01:29:34 user nova-compute[75215]: </domain>
Nov 11 01:29:34 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-129843831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-129843831',id=1,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-9q8yhegy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:24Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=330defc6-9b43-4f1e-9a76-94b23750e1b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:4c:95,bridge_name='br-int',has_traffic_filtering=True,id=eeda3b00-3677-4dd4-bad3-9a7439540308,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeda3b00-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG os_vif [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:4c:95,bridge_name='br-int',has_traffic_filtering=True,id=eeda3b00-3677-4dd4-bad3-9a7439540308,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeda3b00-36') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Releasing lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Instance network_info: |[{"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1194139d-2edc-5efe-8965-5c5e8f205429', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Start _get_guest_xml network_info=[{"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeda3b00-36, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeeda3b00-36, col_values=(('qos', UUID('760e5e49-7355-46ca-b3c3-96900bd65aa6')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeeda3b00-36, col_values=(('external_ids', {'iface-id': 'eeda3b00-3677-4dd4-bad3-9a7439540308', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:4c:95', 'vm-uuid': '330defc6-9b43-4f1e-9a76-94b23750e1b0'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-827548124',display_name='tempest-ServerActionsTestOtherB-server-827548124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-827548124',id=2,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU+LVdAVbavG+XDnmduqLHiTT53kL3rXZl6lB1qlgCBq2vDQATnb3Mfb6qv4iKSMk6lmGgM+C/2DEQRENP7V1VA9I9aAAHA9et2JIQVa1XfuT4GioCqObY3JlTc/6ZLlw==',key_name='tempest-keypair-1395820682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='001c51cb81da454b931d9ede62e34564',ramdisk_id='',reservation_id='r-ew2ngte6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-277602743',owner_user_name='tempest-ServerActionsTestOtherB-277602743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55650e69ce924b388eb12cb397127576',uuid=29f1747f-8209-4d8f-9929-d6227763b5c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Converting VIF {"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=2771b3b6-1454-4fae-bfc8-3c1c803324b0,network=Network(ed776f62-57b5-44f3-8f4c-31761a1f071c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2771b3b6-14') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lazy-loading 'pci_devices' on Instance uuid 29f1747f-8209-4d8f-9929-d6227763b5c5 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: INFO os_vif [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:4c:95,bridge_name='br-int',has_traffic_filtering=True,id=eeda3b00-3677-4dd4-bad3-9a7439540308,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeda3b00-36')
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:29:34 user nova-compute[75215]:   <uuid>29f1747f-8209-4d8f-9929-d6227763b5c5</uuid>
Nov 11 01:29:34 user nova-compute[75215]:   <name>instance-00000002</name>
Nov 11 01:29:34 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:29:34 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:29:34 user nova-compute[75215]:   <metadata>
Nov 11 01:29:34 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:29:34 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherB-server-827548124</nova:name>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:29:34</nova:creationTime>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:29:34 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:29:34 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:owner>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:user uuid="55650e69ce924b388eb12cb397127576">tempest-ServerActionsTestOtherB-277602743-project-member</nova:user>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:project uuid="001c51cb81da454b931d9ede62e34564">tempest-ServerActionsTestOtherB-277602743</nova:project>
Nov 11 01:29:34 user nova-compute[75215]:       </nova:owner>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:29:34 user nova-compute[75215]:       <nova:ports>
Nov 11 01:29:34 user nova-compute[75215]:         <nova:port uuid="2771b3b6-1454-4fae-bfc8-3c1c803324b0">
Nov 11 01:29:34 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 01:29:34 user nova-compute[75215]:         </nova:port>
Nov 11 01:29:34 user nova-compute[75215]:       </nova:ports>
Nov 11 01:29:34 user nova-compute[75215]:     </nova:instance>
Nov 11 01:29:34 user nova-compute[75215]:   </metadata>
Nov 11 01:29:34 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:29:34 user nova-compute[75215]:     <system>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="serial">29f1747f-8209-4d8f-9929-d6227763b5c5</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="uuid">29f1747f-8209-4d8f-9929-d6227763b5c5</entry>
Nov 11 01:29:34 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:29:34 user nova-compute[75215]:     </system>
Nov 11 01:29:34 user nova-compute[75215]:   </sysinfo>
Nov 11 01:29:34 user nova-compute[75215]:   <os>
Nov 11 01:29:34 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:29:34 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:29:34 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:29:34 user nova-compute[75215]:   </os>
Nov 11 01:29:34 user nova-compute[75215]:   <features>
Nov 11 01:29:34 user nova-compute[75215]:     <acpi/>
Nov 11 01:29:34 user nova-compute[75215]:     <apic/>
Nov 11 01:29:34 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:29:34 user nova-compute[75215]:   </features>
Nov 11 01:29:34 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:29:34 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:29:34 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:29:34 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:29:34 user nova-compute[75215]:   </clock>
Nov 11 01:29:34 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:29:34 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:29:34 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:29:34 user nova-compute[75215]:   </cpu>
Nov 11 01:29:34 user nova-compute[75215]:   <devices>
Nov 11 01:29:34 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:29:34 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:29:34 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk"/>
Nov 11 01:29:34 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:29:34 user nova-compute[75215]:     </disk>
Nov 11 01:29:34 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:29:34 user nova-compute[75215]:       <mac address="fa:16:3e:8d:bb:36"/>
Nov 11 01:29:34 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:34 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:29:34 user nova-compute[75215]:       <target dev="tap2771b3b6-14"/>
Nov 11 01:29:34 user nova-compute[75215]:     </interface>
Nov 11 01:29:34 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:29:34 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/console.log" append="off"/>
Nov 11 01:29:34 user nova-compute[75215]:     </serial>
Nov 11 01:29:34 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:29:34 user nova-compute[75215]:     <video>
Nov 11 01:29:34 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:34 user nova-compute[75215]:     </video>
Nov 11 01:29:34 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:29:34 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:29:34 user nova-compute[75215]:     </rng>
Nov 11 01:29:34 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:29:34 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:29:34 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:29:34 user nova-compute[75215]:     </memballoon>
Nov 11 01:29:34 user nova-compute[75215]:   </devices>
Nov 11 01:29:34 user nova-compute[75215]: </domain>
Nov 11 01:29:34 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-827548124',display_name='tempest-ServerActionsTestOtherB-server-827548124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-827548124',id=2,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU+LVdAVbavG+XDnmduqLHiTT53kL3rXZl6lB1qlgCBq2vDQATnb3Mfb6qv4iKSMk6lmGgM+C/2DEQRENP7V1VA9I9aAAHA9et2JIQVa1XfuT4GioCqObY3JlTc/6ZLlw==',key_name='tempest-keypair-1395820682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='001c51cb81da454b931d9ede62e34564',ramdisk_id='',reservation_id='r-ew2ngte6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-277602743',owner_user_name='tempest-ServerActionsTestOtherB-277602743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55650e69ce924b388eb12cb397127576',uuid=29f1747f-8209-4d8f-9929-d6227763b5c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Converting VIF {"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=2771b3b6-1454-4fae-bfc8-3c1c803324b0,network=Network(ed776f62-57b5-44f3-8f4c-31761a1f071c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2771b3b6-14') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG os_vif [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=2771b3b6-1454-4fae-bfc8-3c1c803324b0,network=Network(ed776f62-57b5-44f3-8f4c-31761a1f071c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2771b3b6-14') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82e70430-9702-5053-b44d-b2d792a12aa2', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2771b3b6-14, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2771b3b6-14, col_values=(('qos', UUID('d845a997-291d-49ea-aaff-92dbc3e960d7')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2771b3b6-14, col_values=(('external_ids', {'iface-id': '2771b3b6-1454-4fae-bfc8-3c1c803324b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:bb:36', 'vm-uuid': '29f1747f-8209-4d8f-9929-d6227763b5c5'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No VIF found with MAC fa:16:3e:44:4c:95, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: INFO os_vif [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=2771b3b6-1454-4fae-bfc8-3c1c803324b0,network=Network(ed776f62-57b5-44f3-8f4c-31761a1f071c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2771b3b6-14')
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] No VIF found with MAC fa:16:3e:8d:bb:36, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Successfully updated port: 544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquired lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-73affa08-88ed-430c-b39b-0fb9fc569ff4 req-9d9fb799-6a17-4e43-93e7-3029ceb5c381 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received event network-changed-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-73affa08-88ed-430c-b39b-0fb9fc569ff4 req-9d9fb799-6a17-4e43-93e7-3029ceb5c381 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Refreshing instance network info cache due to event network-changed-2771b3b6-1454-4fae-bfc8-3c1c803324b0. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73affa08-88ed-430c-b39b-0fb9fc569ff4 req-9d9fb799-6a17-4e43-93e7-3029ceb5c381 service nova] Acquiring lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73affa08-88ed-430c-b39b-0fb9fc569ff4 req-9d9fb799-6a17-4e43-93e7-3029ceb5c381 service nova] Acquired lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-73affa08-88ed-430c-b39b-0fb9fc569ff4 req-9d9fb799-6a17-4e43-93e7-3029ceb5c381 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Refreshing network info cache for port 2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-d29dc8ec-7990-4773-b8b3-cdb63d35d6aa req-82f1e6ff-2388-46fb-b333-e320cf1fc30b service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-changed-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-d29dc8ec-7990-4773-b8b3-cdb63d35d6aa req-82f1e6ff-2388-46fb-b333-e320cf1fc30b service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Refreshing instance network info cache due to event network-changed-544706ff-9665-4194-8957-4435ae082aac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d29dc8ec-7990-4773-b8b3-cdb63d35d6aa req-82f1e6ff-2388-46fb-b333-e320cf1fc30b service nova] Acquiring lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Releasing lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Instance network_info: |[{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d29dc8ec-7990-4773-b8b3-cdb63d35d6aa req-82f1e6ff-2388-46fb-b333-e320cf1fc30b service nova] Acquired lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-d29dc8ec-7990-4773-b8b3-cdb63d35d6aa req-82f1e6ff-2388-46fb-b333-e320cf1fc30b service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Refreshing network info cache for port 544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Start _get_guest_xml network_info=[{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:29:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-976415081',display_name='tempest-ServerActionsTestOtherA-server-976415081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-976415081',id=5,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-gte8n3k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=ad403c50-a8fe-442f-9189-0a6925580739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:57:12,bridge_name='br-int',has_traffic_filtering=True,id=544706ff-9665-4194-8957-4435ae082aac,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544706ff-96') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.objects.instance [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'pci_devices' on Instance uuid ad403c50-a8fe-442f-9189-0a6925580739 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:29:35 user nova-compute[75215]:   <uuid>ad403c50-a8fe-442f-9189-0a6925580739</uuid>
Nov 11 01:29:35 user nova-compute[75215]:   <name>instance-00000005</name>
Nov 11 01:29:35 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:29:35 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:29:35 user nova-compute[75215]:   <metadata>
Nov 11 01:29:35 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:29:35 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:29:35 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherA-server-976415081</nova:name>
Nov 11 01:29:35 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:29:35</nova:creationTime>
Nov 11 01:29:35 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:29:35 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:29:35 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:29:35 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:29:35 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:29:35 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:29:35 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:29:35 user nova-compute[75215]:       <nova:owner>
Nov 11 01:29:35 user nova-compute[75215]:         <nova:user uuid="44e25bace5db43638b4eedfeb9215e24">tempest-ServerActionsTestOtherA-802983068-project-member</nova:user>
Nov 11 01:29:35 user nova-compute[75215]:         <nova:project uuid="c6fb80bd889f488bbfa25060dca25bb8">tempest-ServerActionsTestOtherA-802983068</nova:project>
Nov 11 01:29:35 user nova-compute[75215]:       </nova:owner>
Nov 11 01:29:35 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:29:35 user nova-compute[75215]:       <nova:ports>
Nov 11 01:29:35 user nova-compute[75215]:         <nova:port uuid="544706ff-9665-4194-8957-4435ae082aac">
Nov 11 01:29:35 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 01:29:35 user nova-compute[75215]:         </nova:port>
Nov 11 01:29:35 user nova-compute[75215]:       </nova:ports>
Nov 11 01:29:35 user nova-compute[75215]:     </nova:instance>
Nov 11 01:29:35 user nova-compute[75215]:   </metadata>
Nov 11 01:29:35 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:29:35 user nova-compute[75215]:     <system>
Nov 11 01:29:35 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:29:35 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:29:35 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:29:35 user nova-compute[75215]:       <entry name="serial">ad403c50-a8fe-442f-9189-0a6925580739</entry>
Nov 11 01:29:35 user nova-compute[75215]:       <entry name="uuid">ad403c50-a8fe-442f-9189-0a6925580739</entry>
Nov 11 01:29:35 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:29:35 user nova-compute[75215]:     </system>
Nov 11 01:29:35 user nova-compute[75215]:   </sysinfo>
Nov 11 01:29:35 user nova-compute[75215]:   <os>
Nov 11 01:29:35 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:29:35 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:29:35 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:29:35 user nova-compute[75215]:   </os>
Nov 11 01:29:35 user nova-compute[75215]:   <features>
Nov 11 01:29:35 user nova-compute[75215]:     <acpi/>
Nov 11 01:29:35 user nova-compute[75215]:     <apic/>
Nov 11 01:29:35 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:29:35 user nova-compute[75215]:   </features>
Nov 11 01:29:35 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:29:35 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:29:35 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:29:35 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:29:35 user nova-compute[75215]:   </clock>
Nov 11 01:29:35 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:29:35 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:29:35 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:29:35 user nova-compute[75215]:   </cpu>
Nov 11 01:29:35 user nova-compute[75215]:   <devices>
Nov 11 01:29:35 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:29:35 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:29:35 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk"/>
Nov 11 01:29:35 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:29:35 user nova-compute[75215]:     </disk>
Nov 11 01:29:35 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:29:35 user nova-compute[75215]:       <mac address="fa:16:3e:6a:57:12"/>
Nov 11 01:29:35 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:35 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:29:35 user nova-compute[75215]:       <target dev="tap544706ff-96"/>
Nov 11 01:29:35 user nova-compute[75215]:     </interface>
Nov 11 01:29:35 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:29:35 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/console.log" append="off"/>
Nov 11 01:29:35 user nova-compute[75215]:     </serial>
Nov 11 01:29:35 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:29:35 user nova-compute[75215]:     <video>
Nov 11 01:29:35 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:35 user nova-compute[75215]:     </video>
Nov 11 01:29:35 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:29:35 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:29:35 user nova-compute[75215]:     </rng>
Nov 11 01:29:35 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:29:35 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:29:35 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:29:35 user nova-compute[75215]:     </memballoon>
Nov 11 01:29:35 user nova-compute[75215]:   </devices>
Nov 11 01:29:35 user nova-compute[75215]: </domain>
Nov 11 01:29:35 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-976415081',display_name='tempest-ServerActionsTestOtherA-server-976415081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-976415081',id=5,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-gte8n3k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=ad403c50-a8fe-442f-9189-0a6925580739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:57:12,bridge_name='br-int',has_traffic_filtering=True,id=544706ff-9665-4194-8957-4435ae082aac,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544706ff-96') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG os_vif [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:57:12,bridge_name='br-int',has_traffic_filtering=True,id=544706ff-9665-4194-8957-4435ae082aac,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544706ff-96') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b79212a-e314-5732-94d0-05a5f4cb8782', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap544706ff-96, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap544706ff-96, col_values=(('qos', UUID('0ce1490e-6e50-456d-82dc-bd6cf8bdcbff')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap544706ff-96, col_values=(('external_ids', {'iface-id': '544706ff-9665-4194-8957-4435ae082aac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:57:12', 'vm-uuid': 'ad403c50-a8fe-442f-9189-0a6925580739'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:35 user nova-compute[75215]: INFO os_vif [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:57:12,bridge_name='br-int',has_traffic_filtering=True,id=544706ff-9665-4194-8957-4435ae082aac,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544706ff-96')
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No VIF found with MAC fa:16:3e:6a:57:12, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Successfully updated port: 9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquired lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-15157633-ee87-4666-8d15-a9520cd128a3 req-52c1276d-455b-4607-bdf1-a9de0d4f1cf5 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updated VIF entry in instance network info cache for port eeda3b00-3677-4dd4-bad3-9a7439540308. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-15157633-ee87-4666-8d15-a9520cd128a3 req-52c1276d-455b-4607-bdf1-a9de0d4f1cf5 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updating instance_info_cache with network_info: [{"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15157633-ee87-4666-8d15-a9520cd128a3 req-52c1276d-455b-4607-bdf1-a9de0d4f1cf5 service nova] Releasing lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-d29dc8ec-7990-4773-b8b3-cdb63d35d6aa req-82f1e6ff-2388-46fb-b333-e320cf1fc30b service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updated VIF entry in instance network info cache for port 544706ff-9665-4194-8957-4435ae082aac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-d29dc8ec-7990-4773-b8b3-cdb63d35d6aa req-82f1e6ff-2388-46fb-b333-e320cf1fc30b service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d29dc8ec-7990-4773-b8b3-cdb63d35d6aa req-82f1e6ff-2388-46fb-b333-e320cf1fc30b service nova] Releasing lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-73affa08-88ed-430c-b39b-0fb9fc569ff4 req-9d9fb799-6a17-4e43-93e7-3029ceb5c381 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updated VIF entry in instance network info cache for port 2771b3b6-1454-4fae-bfc8-3c1c803324b0. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-73affa08-88ed-430c-b39b-0fb9fc569ff4 req-9d9fb799-6a17-4e43-93e7-3029ceb5c381 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updating instance_info_cache with network_info: [{"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73affa08-88ed-430c-b39b-0fb9fc569ff4 req-9d9fb799-6a17-4e43-93e7-3029ceb5c381 service nova] Releasing lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Releasing lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance network_info: |[{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Start _get_guest_xml network_info=[{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:29:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'pci_devices' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:29:36 user nova-compute[75215]:   <uuid>29f5d275-78e7-4292-98c8-d12f47f28fbf</uuid>
Nov 11 01:29:36 user nova-compute[75215]:   <name>instance-00000004</name>
Nov 11 01:29:36 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:29:36 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:29:36 user nova-compute[75215]:   <metadata>
Nov 11 01:29:36 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:29:36 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:29:36 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeTestJSON-server-1742806291</nova:name>
Nov 11 01:29:36 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:29:36</nova:creationTime>
Nov 11 01:29:36 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:29:36 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:29:36 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:29:36 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:29:36 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:29:36 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:29:36 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:29:36 user nova-compute[75215]:       <nova:owner>
Nov 11 01:29:36 user nova-compute[75215]:         <nova:user uuid="285cd483fbdc4e4faec7a1bbd414ca7f">tempest-AttachVolumeTestJSON-1999559004-project-member</nova:user>
Nov 11 01:29:36 user nova-compute[75215]:         <nova:project uuid="f71c4317ced540a1a841f41cb9929b7b">tempest-AttachVolumeTestJSON-1999559004</nova:project>
Nov 11 01:29:36 user nova-compute[75215]:       </nova:owner>
Nov 11 01:29:36 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:29:36 user nova-compute[75215]:       <nova:ports>
Nov 11 01:29:36 user nova-compute[75215]:         <nova:port uuid="9fd51c5f-2f3b-4df5-92c8-3d84fe37691b">
Nov 11 01:29:36 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:29:36 user nova-compute[75215]:         </nova:port>
Nov 11 01:29:36 user nova-compute[75215]:       </nova:ports>
Nov 11 01:29:36 user nova-compute[75215]:     </nova:instance>
Nov 11 01:29:36 user nova-compute[75215]:   </metadata>
Nov 11 01:29:36 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:29:36 user nova-compute[75215]:     <system>
Nov 11 01:29:36 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:29:36 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:29:36 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:29:36 user nova-compute[75215]:       <entry name="serial">29f5d275-78e7-4292-98c8-d12f47f28fbf</entry>
Nov 11 01:29:36 user nova-compute[75215]:       <entry name="uuid">29f5d275-78e7-4292-98c8-d12f47f28fbf</entry>
Nov 11 01:29:36 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:29:36 user nova-compute[75215]:     </system>
Nov 11 01:29:36 user nova-compute[75215]:   </sysinfo>
Nov 11 01:29:36 user nova-compute[75215]:   <os>
Nov 11 01:29:36 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:29:36 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:29:36 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:29:36 user nova-compute[75215]:   </os>
Nov 11 01:29:36 user nova-compute[75215]:   <features>
Nov 11 01:29:36 user nova-compute[75215]:     <acpi/>
Nov 11 01:29:36 user nova-compute[75215]:     <apic/>
Nov 11 01:29:36 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:29:36 user nova-compute[75215]:   </features>
Nov 11 01:29:36 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:29:36 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:29:36 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:29:36 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:29:36 user nova-compute[75215]:   </clock>
Nov 11 01:29:36 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:29:36 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:29:36 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:29:36 user nova-compute[75215]:   </cpu>
Nov 11 01:29:36 user nova-compute[75215]:   <devices>
Nov 11 01:29:36 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:29:36 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:29:36 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk"/>
Nov 11 01:29:36 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:29:36 user nova-compute[75215]:     </disk>
Nov 11 01:29:36 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:29:36 user nova-compute[75215]:       <mac address="fa:16:3e:7e:c3:e5"/>
Nov 11 01:29:36 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:36 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:29:36 user nova-compute[75215]:       <target dev="tap9fd51c5f-2f"/>
Nov 11 01:29:36 user nova-compute[75215]:     </interface>
Nov 11 01:29:36 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:29:36 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/console.log" append="off"/>
Nov 11 01:29:36 user nova-compute[75215]:     </serial>
Nov 11 01:29:36 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:29:36 user nova-compute[75215]:     <video>
Nov 11 01:29:36 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:36 user nova-compute[75215]:     </video>
Nov 11 01:29:36 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:29:36 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:29:36 user nova-compute[75215]:     </rng>
Nov 11 01:29:36 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:29:36 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:29:36 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:29:36 user nova-compute[75215]:     </memballoon>
Nov 11 01:29:36 user nova-compute[75215]:   </devices>
Nov 11 01:29:36 user nova-compute[75215]: </domain>
Nov 11 01:29:36 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG os_vif [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ceffea16-bab8-5bca-9457-dc3e6e10fd5a', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fd51c5f-2f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fd51c5f-2f, col_values=(('qos', UUID('3e159fa8-c829-4c82-98a1-700074a6494e')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fd51c5f-2f, col_values=(('external_ids', {'iface-id': '9fd51c5f-2f3b-4df5-92c8-3d84fe37691b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:c3:e5', 'vm-uuid': '29f5d275-78e7-4292-98c8-d12f47f28fbf'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-c7f9ba63-cdd1-4429-9b13-e47725b8e7ab req-cdb1ac18-b952-4a0b-985f-48da621e5fd2 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-changed-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-c7f9ba63-cdd1-4429-9b13-e47725b8e7ab req-cdb1ac18-b952-4a0b-985f-48da621e5fd2 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Refreshing instance network info cache due to event network-changed-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c7f9ba63-cdd1-4429-9b13-e47725b8e7ab req-cdb1ac18-b952-4a0b-985f-48da621e5fd2 service nova] Acquiring lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c7f9ba63-cdd1-4429-9b13-e47725b8e7ab req-cdb1ac18-b952-4a0b-985f-48da621e5fd2 service nova] Acquired lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-c7f9ba63-cdd1-4429-9b13-e47725b8e7ab req-cdb1ac18-b952-4a0b-985f-48da621e5fd2 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Refreshing network info cache for port 9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:37 user nova-compute[75215]: INFO os_vif [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f')
Nov 11 01:29:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:29:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No VIF found with MAC fa:16:3e:7e:c3:e5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:29:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-c7f9ba63-cdd1-4429-9b13-e47725b8e7ab req-cdb1ac18-b952-4a0b-985f-48da621e5fd2 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updated VIF entry in instance network info cache for port 9fd51c5f-2f3b-4df5-92c8-3d84fe37691b. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:29:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-c7f9ba63-cdd1-4429-9b13-e47725b8e7ab req-cdb1ac18-b952-4a0b-985f-48da621e5fd2 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c7f9ba63-cdd1-4429-9b13-e47725b8e7ab req-cdb1ac18-b952-4a0b-985f-48da621e5fd2 service nova] Releasing lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:29:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Instance spawned successfully.
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:39 user nova-compute[75215]: INFO nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Took 14.21 seconds to spawn the instance on the hypervisor.
Nov 11 01:29:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:29:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:40 user nova-compute[75215]: INFO nova.compute.manager [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Took 15.44 seconds to build instance.
Nov 11 01:29:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cda701bf-3630-476b-9f30-b685d439f6f2 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.656s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:29:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Instance spawned successfully.
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:42 user nova-compute[75215]: INFO nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Took 17.32 seconds to spawn the instance on the hypervisor.
Nov 11 01:29:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:42 user nova-compute[75215]: INFO nova.compute.manager [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Took 18.59 seconds to build instance.
Nov 11 01:29:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9c003760-1a4a-43f3-a029-ba87be124d07 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.836s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance spawned successfully.
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Instance spawned successfully.
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Instance spawned successfully.
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Took 15.83 seconds to spawn the instance on the hypervisor.
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Took 19.94 seconds to spawn the instance on the hypervisor.
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.compute.manager [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Took 20.98 seconds to build instance.
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.compute.manager [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Took 16.93 seconds to build instance.
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Took 14.57 seconds to spawn the instance on the hypervisor.
Nov 11 01:29:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d01ee0ab-93ff-4b6e-8872-e167cbee652c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.170s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-729b9562-8624-4c24-9c74-7444ab133093 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.364s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:44 user nova-compute[75215]: INFO nova.compute.manager [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Took 15.42 seconds to build instance.
Nov 11 01:29:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-28f12b1f-82e4-4185-b0ba-91eccc8052ec tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "ad403c50-a8fe-442f-9189-0a6925580739" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.768s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:29:45 user nova-compute[75215]: INFO nova.compute.claims [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Claim successful on node user
Nov 11 01:29:46 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:29:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:29:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:29:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Creating image(s)
Nov 11 01:29:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "/opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "/opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG nova.policy [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80c298c7b4074bbcab91160215fb8537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edee432deba4b9fa073619e1f9d99bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.394s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.241s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk 1073741824" returned: 0 in 0.063s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.288s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Cannot resize image /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Ensure instance console log exists: /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Successfully created port: 7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:29:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:49 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Successfully updated port: 7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:29:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquired lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:49 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:29:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-a67c2af7-edf8-47c8-a1be-dfaa56193cf1 req-77b6b3de-7f5a-48d5-997f-6944be8c7cce service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received event network-changed-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-a67c2af7-edf8-47c8-a1be-dfaa56193cf1 req-77b6b3de-7f5a-48d5-997f-6944be8c7cce service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Refreshing instance network info cache due to event network-changed-7b29616a-00a0-4643-b438-b923d6713538. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:29:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a67c2af7-edf8-47c8-a1be-dfaa56193cf1 req-77b6b3de-7f5a-48d5-997f-6944be8c7cce service nova] Acquiring lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:49 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updating instance_info_cache with network_info: [{"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Releasing lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Instance network_info: |[{"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a67c2af7-edf8-47c8-a1be-dfaa56193cf1 req-77b6b3de-7f5a-48d5-997f-6944be8c7cce service nova] Acquired lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-a67c2af7-edf8-47c8-a1be-dfaa56193cf1 req-77b6b3de-7f5a-48d5-997f-6944be8c7cce service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Refreshing network info cache for port 7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Start _get_guest_xml network_info=[{"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:29:50 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:50 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1924519002',display_name='tempest-VolumesAdminNegativeTest-server-1924519002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1924519002',id=6,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKH/v8XOzhZRJ2sCHE7hOYk3rv0FltctQ9glr5yYhh/Yi+Wn4NgqMTE67p1x9TaGqKerrRxT17OniCfwhatJ/Yy/Pg/bX1qWukSN399Hx4EF/3ghnJ1qRTzTohyFoOltpQ==',key_name='tempest-keypair-1905672387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9edee432deba4b9fa073619e1f9d99bb',ramdisk_id='',reservation_id='r-xv1hx5u9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1899827326',owner_user_name='tempest-VolumesAdminNegativeTest-1899827326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80c298c7b4074bbcab91160215fb8537',uuid=ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converting VIF {"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:95:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b29616a-00a0-4643-b438-b923d6713538,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b29616a-00') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lazy-loading 'pci_devices' on Instance uuid ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:29:50 user nova-compute[75215]:   <uuid>ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14</uuid>
Nov 11 01:29:50 user nova-compute[75215]:   <name>instance-00000006</name>
Nov 11 01:29:50 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:29:50 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:29:50 user nova-compute[75215]:   <metadata>
Nov 11 01:29:50 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:29:50 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:29:50 user nova-compute[75215]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1924519002</nova:name>
Nov 11 01:29:50 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:29:50</nova:creationTime>
Nov 11 01:29:50 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:29:50 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:29:50 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:29:50 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:29:50 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:29:50 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:29:50 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:29:50 user nova-compute[75215]:       <nova:owner>
Nov 11 01:29:50 user nova-compute[75215]:         <nova:user uuid="80c298c7b4074bbcab91160215fb8537">tempest-VolumesAdminNegativeTest-1899827326-project-member</nova:user>
Nov 11 01:29:50 user nova-compute[75215]:         <nova:project uuid="9edee432deba4b9fa073619e1f9d99bb">tempest-VolumesAdminNegativeTest-1899827326</nova:project>
Nov 11 01:29:50 user nova-compute[75215]:       </nova:owner>
Nov 11 01:29:50 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:29:50 user nova-compute[75215]:       <nova:ports>
Nov 11 01:29:50 user nova-compute[75215]:         <nova:port uuid="7b29616a-00a0-4643-b438-b923d6713538">
Nov 11 01:29:50 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 11 01:29:50 user nova-compute[75215]:         </nova:port>
Nov 11 01:29:50 user nova-compute[75215]:       </nova:ports>
Nov 11 01:29:50 user nova-compute[75215]:     </nova:instance>
Nov 11 01:29:50 user nova-compute[75215]:   </metadata>
Nov 11 01:29:50 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:29:50 user nova-compute[75215]:     <system>
Nov 11 01:29:50 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:29:50 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:29:50 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:29:50 user nova-compute[75215]:       <entry name="serial">ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14</entry>
Nov 11 01:29:50 user nova-compute[75215]:       <entry name="uuid">ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14</entry>
Nov 11 01:29:50 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:29:50 user nova-compute[75215]:     </system>
Nov 11 01:29:50 user nova-compute[75215]:   </sysinfo>
Nov 11 01:29:50 user nova-compute[75215]:   <os>
Nov 11 01:29:50 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:29:50 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:29:50 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:29:50 user nova-compute[75215]:   </os>
Nov 11 01:29:50 user nova-compute[75215]:   <features>
Nov 11 01:29:50 user nova-compute[75215]:     <acpi/>
Nov 11 01:29:50 user nova-compute[75215]:     <apic/>
Nov 11 01:29:50 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:29:50 user nova-compute[75215]:   </features>
Nov 11 01:29:50 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:29:50 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:29:50 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:29:50 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:29:50 user nova-compute[75215]:   </clock>
Nov 11 01:29:50 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:29:50 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:29:50 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:29:50 user nova-compute[75215]:   </cpu>
Nov 11 01:29:50 user nova-compute[75215]:   <devices>
Nov 11 01:29:50 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:29:50 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:29:50 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk"/>
Nov 11 01:29:50 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:29:50 user nova-compute[75215]:     </disk>
Nov 11 01:29:50 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:29:50 user nova-compute[75215]:       <mac address="fa:16:3e:80:95:2d"/>
Nov 11 01:29:50 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:50 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:29:50 user nova-compute[75215]:       <target dev="tap7b29616a-00"/>
Nov 11 01:29:50 user nova-compute[75215]:     </interface>
Nov 11 01:29:50 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:29:50 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/console.log" append="off"/>
Nov 11 01:29:50 user nova-compute[75215]:     </serial>
Nov 11 01:29:50 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:29:50 user nova-compute[75215]:     <video>
Nov 11 01:29:50 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:50 user nova-compute[75215]:     </video>
Nov 11 01:29:50 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:29:50 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:29:50 user nova-compute[75215]:     </rng>
Nov 11 01:29:50 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:29:50 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:29:50 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:29:50 user nova-compute[75215]:     </memballoon>
Nov 11 01:29:50 user nova-compute[75215]:   </devices>
Nov 11 01:29:50 user nova-compute[75215]: </domain>
Nov 11 01:29:50 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1924519002',display_name='tempest-VolumesAdminNegativeTest-server-1924519002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1924519002',id=6,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKH/v8XOzhZRJ2sCHE7hOYk3rv0FltctQ9glr5yYhh/Yi+Wn4NgqMTE67p1x9TaGqKerrRxT17OniCfwhatJ/Yy/Pg/bX1qWukSN399Hx4EF/3ghnJ1qRTzTohyFoOltpQ==',key_name='tempest-keypair-1905672387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9edee432deba4b9fa073619e1f9d99bb',ramdisk_id='',reservation_id='r-xv1hx5u9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1899827326',owner_user_name='tempest-VolumesAdminNegativeTest-1899827326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80c298c7b4074bbcab91160215fb8537',uuid=ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converting VIF {"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:95:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b29616a-00a0-4643-b438-b923d6713538,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b29616a-00') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG os_vif [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:95:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b29616a-00a0-4643-b438-b923d6713538,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b29616a-00') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89cfbe92-cc1f-532c-bc8e-56b900420ad7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b29616a-00, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b29616a-00, col_values=(('qos', UUID('a63c9f83-815f-491d-aefb-9a7c71943568')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b29616a-00, col_values=(('external_ids', {'iface-id': '7b29616a-00a0-4643-b438-b923d6713538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:95:2d', 'vm-uuid': 'ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:50 user nova-compute[75215]: INFO os_vif [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:95:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b29616a-00a0-4643-b438-b923d6713538,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b29616a-00')
Nov 11 01:29:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] No VIF found with MAC fa:16:3e:80:95:2d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:29:51 user nova-compute[75215]: INFO nova.compute.claims [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Claim successful on node user
Nov 11 01:29:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-a67c2af7-edf8-47c8-a1be-dfaa56193cf1 req-77b6b3de-7f5a-48d5-997f-6944be8c7cce service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updated VIF entry in instance network info cache for port 7b29616a-00a0-4643-b438-b923d6713538. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-a67c2af7-edf8-47c8-a1be-dfaa56193cf1 req-77b6b3de-7f5a-48d5-997f-6944be8c7cce service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updating instance_info_cache with network_info: [{"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a67c2af7-edf8-47c8-a1be-dfaa56193cf1 req-77b6b3de-7f5a-48d5-997f-6944be8c7cce service nova] Releasing lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received event network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] No waiting events found dispatching network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:29:52 user nova-compute[75215]: WARNING nova.compute.manager [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received unexpected event network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 for instance with vm_state active and task_state None.
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received event network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] No waiting events found dispatching network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:29:52 user nova-compute[75215]: WARNING nova.compute.manager [req-f098a4ea-04ba-4212-a1e4-a1aebb66f16b req-4236d8b9-d3a4-4391-b723-7bb060aed17a service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received unexpected event network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 for instance with vm_state active and task_state None.
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-5872afe6-81d5-4464-ab9e-61bde38d3cf2 req-a3607ad1-13f7-4e20-9c5d-e52213bd05b0 service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received event network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5872afe6-81d5-4464-ab9e-61bde38d3cf2 req-a3607ad1-13f7-4e20-9c5d-e52213bd05b0 service nova] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5872afe6-81d5-4464-ab9e-61bde38d3cf2 req-a3607ad1-13f7-4e20-9c5d-e52213bd05b0 service nova] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5872afe6-81d5-4464-ab9e-61bde38d3cf2 req-a3607ad1-13f7-4e20-9c5d-e52213bd05b0 service nova] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-5872afe6-81d5-4464-ab9e-61bde38d3cf2 req-a3607ad1-13f7-4e20-9c5d-e52213bd05b0 service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] No waiting events found dispatching network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:29:52 user nova-compute[75215]: WARNING nova.compute.manager [req-5872afe6-81d5-4464-ab9e-61bde38d3cf2 req-a3607ad1-13f7-4e20-9c5d-e52213bd05b0 service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received unexpected event network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc for instance with vm_state active and task_state None.
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:29:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:29:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Creating image(s)
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "/opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "/opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "e6cc1d68996fa4e115df27f975fdf68ec4d1637f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "e6cc1d68996fa4e115df27f975fdf68ec4d1637f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:53 user nova-compute[75215]: DEBUG nova.policy [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '326e917356ad47e0bc1b9ae334398318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde2f8d401c74e5fae4f7e722c0ca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:29:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f.part --force-share --output=json" returned: 0 in 0.323s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:53 user nova-compute[75215]: DEBUG nova.virt.images [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] 60a0bb82-d06b-43ba-b339-863e1f786c86 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:29:53 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:29:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f.part /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f.part /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f.converted" returned: 0 in 0.350s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c539337-1b55-438b-ad26-5b43804fa9e0 req-89f52eca-a7c4-44cc-b05c-fceabec45d0d service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received event network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c539337-1b55-438b-ad26-5b43804fa9e0 req-89f52eca-a7c4-44cc-b05c-fceabec45d0d service nova] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c539337-1b55-438b-ad26-5b43804fa9e0 req-89f52eca-a7c4-44cc-b05c-fceabec45d0d service nova] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c539337-1b55-438b-ad26-5b43804fa9e0 req-89f52eca-a7c4-44cc-b05c-fceabec45d0d service nova] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c539337-1b55-438b-ad26-5b43804fa9e0 req-89f52eca-a7c4-44cc-b05c-fceabec45d0d service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] No waiting events found dispatching network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:29:54 user nova-compute[75215]: WARNING nova.compute.manager [req-0c539337-1b55-438b-ad26-5b43804fa9e0 req-89f52eca-a7c4-44cc-b05c-fceabec45d0d service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received unexpected event network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc for instance with vm_state active and task_state None.
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "e6cc1d68996fa4e115df27f975fdf68ec4d1637f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.707s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f --force-share --output=json" returned: 0 in 0.280s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "e6cc1d68996fa4e115df27f975fdf68ec4d1637f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "e6cc1d68996fa4e115df27f975fdf68ec4d1637f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Successfully created port: bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f,backing_fmt=raw /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f,backing_fmt=raw /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk 1073741824" returned: 0 in 0.088s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "e6cc1d68996fa4e115df27f975fdf68ec4d1637f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f --force-share --output=json" returned: 0 in 0.233s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Cannot resize image /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Ensure instance console log exists: /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.009s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Successfully updated port: bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquired lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-4925334d-7818-4d54-aecb-c8993162b6ac req-92a26c32-7dbb-4afb-8909-6bdf37847d0a service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received event network-changed-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-4925334d-7818-4d54-aecb-c8993162b6ac req-92a26c32-7dbb-4afb-8909-6bdf37847d0a service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Refreshing instance network info cache due to event network-changed-bdc930c6-56b8-46bb-8645-496286713b8c. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:29:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4925334d-7818-4d54-aecb-c8993162b6ac req-92a26c32-7dbb-4afb-8909-6bdf37847d0a service nova] Acquiring lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:29:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Instance spawned successfully.
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:29:56 user nova-compute[75215]: INFO nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Took 9.21 seconds to spawn the instance on the hypervisor.
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:29:56 user nova-compute[75215]: INFO nova.compute.manager [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Took 10.42 seconds to build instance.
Nov 11 01:29:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8ab0ae6d-d66b-400f-bca4-d23e20946b62 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.593s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Updating instance_info_cache with network_info: [{"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Releasing lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Instance network_info: |[{"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4925334d-7818-4d54-aecb-c8993162b6ac req-92a26c32-7dbb-4afb-8909-6bdf37847d0a service nova] Acquired lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-4925334d-7818-4d54-aecb-c8993162b6ac req-92a26c32-7dbb-4afb-8909-6bdf37847d0a service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Refreshing network info cache for port bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Start _get_guest_xml network_info=[{"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:29:42Z,direct_url=<?>,disk_format='qcow2',id=60a0bb82-d06b-43ba-b339-863e1f786c86,min_disk=0,min_ram=0,name='',owner='f1641be053614d0994ac09b309abfab5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:29:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'image_id': '60a0bb82-d06b-43ba-b339-863e1f786c86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:29:56 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:56 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:29:42Z,direct_url=<?>,disk_format='qcow2',id=60a0bb82-d06b-43ba-b339-863e1f786c86,min_disk=0,min_ram=0,name='',owner='f1641be053614d0994ac09b309abfab5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:29:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1897854606',display_name='tempest-AttachSCSIVolumeTestJSON-server-1897854606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1897854606',id=7,image_ref='60a0bb82-d06b-43ba-b339-863e1f786c86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnLSWiVwvihukaEBkR/Hbzs+ugegITSdge03YF0fgFj+mgXm95IHrdAPk4A4yx6H0Y1sm4Xnvo3OQQTGQEeUIH7iyB8L9WFJT9UfYy8bIlc1Ts2a8/MI5F19cdi4cz69A==',key_name='tempest-keypair-963031833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dde2f8d401c74e5fae4f7e722c0ca498',ramdisk_id='',reservation_id='r-xqaueeaj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60a0bb82-d06b-43ba-b339-863e1f786c86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-62693113',owner_user_name='tempest-AttachSCSIVolumeTestJSON-62693113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='326e917356ad47e0bc1b9ae334398318',uuid=1a7404dd-181a-40d5-af0a-e6b2dd8e1958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Converting VIF {"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=bdc930c6-56b8-46bb-8645-496286713b8c,network=Network(eb6db38a-1cd1-4490-9b77-7ba5fcc82361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc930c6-56') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.objects.instance [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:29:56 user nova-compute[75215]:   <uuid>1a7404dd-181a-40d5-af0a-e6b2dd8e1958</uuid>
Nov 11 01:29:56 user nova-compute[75215]:   <name>instance-00000007</name>
Nov 11 01:29:56 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:29:56 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:29:56 user nova-compute[75215]:   <metadata>
Nov 11 01:29:56 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:29:56 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:29:56 user nova-compute[75215]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1897854606</nova:name>
Nov 11 01:29:56 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:29:56</nova:creationTime>
Nov 11 01:29:56 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:29:56 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:29:56 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:29:56 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:29:56 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:29:56 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:29:56 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:29:56 user nova-compute[75215]:       <nova:owner>
Nov 11 01:29:56 user nova-compute[75215]:         <nova:user uuid="326e917356ad47e0bc1b9ae334398318">tempest-AttachSCSIVolumeTestJSON-62693113-project-member</nova:user>
Nov 11 01:29:56 user nova-compute[75215]:         <nova:project uuid="dde2f8d401c74e5fae4f7e722c0ca498">tempest-AttachSCSIVolumeTestJSON-62693113</nova:project>
Nov 11 01:29:56 user nova-compute[75215]:       </nova:owner>
Nov 11 01:29:56 user nova-compute[75215]:       <nova:root type="image" uuid="60a0bb82-d06b-43ba-b339-863e1f786c86"/>
Nov 11 01:29:56 user nova-compute[75215]:       <nova:ports>
Nov 11 01:29:56 user nova-compute[75215]:         <nova:port uuid="bdc930c6-56b8-46bb-8645-496286713b8c">
Nov 11 01:29:56 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 01:29:56 user nova-compute[75215]:         </nova:port>
Nov 11 01:29:56 user nova-compute[75215]:       </nova:ports>
Nov 11 01:29:56 user nova-compute[75215]:     </nova:instance>
Nov 11 01:29:56 user nova-compute[75215]:   </metadata>
Nov 11 01:29:56 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:29:56 user nova-compute[75215]:     <system>
Nov 11 01:29:56 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:29:56 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:29:56 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:29:56 user nova-compute[75215]:       <entry name="serial">1a7404dd-181a-40d5-af0a-e6b2dd8e1958</entry>
Nov 11 01:29:56 user nova-compute[75215]:       <entry name="uuid">1a7404dd-181a-40d5-af0a-e6b2dd8e1958</entry>
Nov 11 01:29:56 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:29:56 user nova-compute[75215]:     </system>
Nov 11 01:29:56 user nova-compute[75215]:   </sysinfo>
Nov 11 01:29:56 user nova-compute[75215]:   <os>
Nov 11 01:29:56 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:29:56 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:29:56 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:29:56 user nova-compute[75215]:   </os>
Nov 11 01:29:56 user nova-compute[75215]:   <features>
Nov 11 01:29:56 user nova-compute[75215]:     <acpi/>
Nov 11 01:29:56 user nova-compute[75215]:     <apic/>
Nov 11 01:29:56 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:29:56 user nova-compute[75215]:   </features>
Nov 11 01:29:56 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:29:56 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:29:56 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:29:56 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:29:56 user nova-compute[75215]:   </clock>
Nov 11 01:29:56 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:29:56 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:29:56 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:29:56 user nova-compute[75215]:   </cpu>
Nov 11 01:29:56 user nova-compute[75215]:   <devices>
Nov 11 01:29:56 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:29:56 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:29:56 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk"/>
Nov 11 01:29:56 user nova-compute[75215]:       <target dev="sda" bus="scsi"/>
Nov 11 01:29:56 user nova-compute[75215]:       <address type="drive" controller="0" unit="0"/>
Nov 11 01:29:56 user nova-compute[75215]:     </disk>
Nov 11 01:29:56 user nova-compute[75215]:     <disk type="file" device="cdrom">
Nov 11 01:29:56 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none"/>
Nov 11 01:29:56 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk.config"/>
Nov 11 01:29:56 user nova-compute[75215]:       <target dev="sdb" bus="scsi"/>
Nov 11 01:29:56 user nova-compute[75215]:       <address type="drive" controller="0" unit="1"/>
Nov 11 01:29:56 user nova-compute[75215]:     </disk>
Nov 11 01:29:56 user nova-compute[75215]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 11 01:29:56 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:29:56 user nova-compute[75215]:       <mac address="fa:16:3e:02:c7:65"/>
Nov 11 01:29:56 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:56 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:29:56 user nova-compute[75215]:       <target dev="tapbdc930c6-56"/>
Nov 11 01:29:56 user nova-compute[75215]:     </interface>
Nov 11 01:29:56 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:29:56 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/console.log" append="off"/>
Nov 11 01:29:56 user nova-compute[75215]:     </serial>
Nov 11 01:29:56 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:29:56 user nova-compute[75215]:     <video>
Nov 11 01:29:56 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:29:56 user nova-compute[75215]:     </video>
Nov 11 01:29:56 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:29:56 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:29:56 user nova-compute[75215]:     </rng>
Nov 11 01:29:56 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:29:56 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:29:56 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:29:56 user nova-compute[75215]:     </memballoon>
Nov 11 01:29:56 user nova-compute[75215]:   </devices>
Nov 11 01:29:56 user nova-compute[75215]: </domain>
Nov 11 01:29:56 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1897854606',display_name='tempest-AttachSCSIVolumeTestJSON-server-1897854606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1897854606',id=7,image_ref='60a0bb82-d06b-43ba-b339-863e1f786c86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnLSWiVwvihukaEBkR/Hbzs+ugegITSdge03YF0fgFj+mgXm95IHrdAPk4A4yx6H0Y1sm4Xnvo3OQQTGQEeUIH7iyB8L9WFJT9UfYy8bIlc1Ts2a8/MI5F19cdi4cz69A==',key_name='tempest-keypair-963031833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dde2f8d401c74e5fae4f7e722c0ca498',ramdisk_id='',reservation_id='r-xqaueeaj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60a0bb82-d06b-43ba-b339-863e1f786c86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-62693113',owner_user_name='tempest-AttachSCSIVolumeTestJSON-62693113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='326e917356ad47e0bc1b9ae334398318',uuid=1a7404dd-181a-40d5-af0a-e6b2dd8e1958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Converting VIF {"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=bdc930c6-56b8-46bb-8645-496286713b8c,network=Network(eb6db38a-1cd1-4490-9b77-7ba5fcc82361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc930c6-56') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG os_vif [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=bdc930c6-56b8-46bb-8645-496286713b8c,network=Network(eb6db38a-1cd1-4490-9b77-7ba5fcc82361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc930c6-56') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f24f8d0-135b-5542-a0ae-01d2f74556d7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdc930c6-56, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdc930c6-56, col_values=(('qos', UUID('0f671b06-1a00-4545-ade4-2fc935cacc19')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdc930c6-56, col_values=(('external_ids', {'iface-id': 'bdc930c6-56b8-46bb-8645-496286713b8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:c7:65', 'vm-uuid': '1a7404dd-181a-40d5-af0a-e6b2dd8e1958'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:56 user nova-compute[75215]: INFO os_vif [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=bdc930c6-56b8-46bb-8645-496286713b8c,network=Network(eb6db38a-1cd1-4490-9b77-7ba5fcc82361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc930c6-56')
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] No BDM found with device name sda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:29:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] No VIF found with MAC fa:16:3e:02:c7:65, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:29:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Using config drive
Nov 11 01:29:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-4925334d-7818-4d54-aecb-c8993162b6ac req-92a26c32-7dbb-4afb-8909-6bdf37847d0a service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Updated VIF entry in instance network info cache for port bdc930c6-56b8-46bb-8645-496286713b8c. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:29:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-4925334d-7818-4d54-aecb-c8993162b6ac req-92a26c32-7dbb-4afb-8909-6bdf37847d0a service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Updating instance_info_cache with network_info: [{"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:29:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4925334d-7818-4d54-aecb-c8993162b6ac req-92a26c32-7dbb-4afb-8909-6bdf37847d0a service nova] Releasing lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:29:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Creating config drive at /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk.config
Nov 11 01:29:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo8e01qd6 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:29:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo8e01qd6" returned: 0 in 0.072s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:29:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:29:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:29:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:29:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:29:59 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:29:59 user nova-compute[75215]: INFO nova.compute.claims [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Claim successful on node user
Nov 11 01:30:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.866s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:00 user nova-compute[75215]: DEBUG nova.policy [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6269f798c52c45ee9ca9aa29a4487798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e369e597968643269939d15256b6ae97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:30:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:30:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:30:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Creating image(s)
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.285s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk 1073741824" returned: 0 in 0.113s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:30:02 user nova-compute[75215]: INFO nova.compute.claims [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Claim successful on node user
Nov 11 01:30:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.308s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Successfully created port: 997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.434s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Cannot resize image /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Ensure instance console log exists: /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-a56e44c9-f6ed-410c-a1bb-568c0c7ce20f req-e9ad9944-c833-40b5-b3cd-cfa452e862f0 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a56e44c9-f6ed-410c-a1bb-568c0c7ce20f req-e9ad9944-c833-40b5-b3cd-cfa452e862f0 service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a56e44c9-f6ed-410c-a1bb-568c0c7ce20f req-e9ad9944-c833-40b5-b3cd-cfa452e862f0 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a56e44c9-f6ed-410c-a1bb-568c0c7ce20f req-e9ad9944-c833-40b5-b3cd-cfa452e862f0 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-a56e44c9-f6ed-410c-a1bb-568c0c7ce20f req-e9ad9944-c833-40b5-b3cd-cfa452e862f0 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:03 user nova-compute[75215]: WARNING nova.compute.manager [req-a56e44c9-f6ed-410c-a1bb-568c0c7ce20f req-e9ad9944-c833-40b5-b3cd-cfa452e862f0 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state active and task_state None.
Nov 11 01:30:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:30:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Instance spawned successfully.
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.639s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:30:03 user nova-compute[75215]: INFO nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Took 11.20 seconds to spawn the instance on the hypervisor.
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:30:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:30:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:30:04 user nova-compute[75215]: INFO nova.compute.manager [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Took 12.52 seconds to build instance.
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.policy [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '387a12092fd94ce6816c35cb1dfe655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4271fe9e96c4367b321196578f8dd20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-71014bc4-2696-445a-8e60-8a639902a395 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.708s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Successfully updated port: 997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquired lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:30:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Creating image(s)
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "/opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "/opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-16162251-a8a2-4f20-90d8-741b1487f2da req-43e2569d-cf3e-4368-a509-c5e6db1da212 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-changed-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-16162251-a8a2-4f20-90d8-741b1487f2da req-43e2569d-cf3e-4368-a509-c5e6db1da212 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Refreshing instance network info cache due to event network-changed-997c39fb-7e21-4af1-acf2-e0e70157b02d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-16162251-a8a2-4f20-90d8-741b1487f2da req-43e2569d-cf3e-4368-a509-c5e6db1da212 service nova] Acquiring lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk 1073741824" returned: 0 in 0.064s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating instance_info_cache with network_info: [{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Releasing lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Instance network_info: |[{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-16162251-a8a2-4f20-90d8-741b1487f2da req-43e2569d-cf3e-4368-a509-c5e6db1da212 service nova] Acquired lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-16162251-a8a2-4f20-90d8-741b1487f2da req-43e2569d-cf3e-4368-a509-c5e6db1da212 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Refreshing network info cache for port 997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Start _get_guest_xml network_info=[{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:30:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:30:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:30:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converting VIF {"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=997c39fb-7e21-4af1-acf2-e0e70157b02d,network=Network(6915f72f-6c26-4506-a9b7-ab1baa663e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap997c39fb-7e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lazy-loading 'pci_devices' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Cannot resize image /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Ensure instance console log exists: /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:30:05 user nova-compute[75215]:   <uuid>c7c8d8f5-5e51-4e02-8001-ea843090f471</uuid>
Nov 11 01:30:05 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 11 01:30:05 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:30:05 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:30:05 user nova-compute[75215]:   <metadata>
Nov 11 01:30:05 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:30:05 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:30:05 user nova-compute[75215]:       <nova:name>tempest-device-tagging-server-1881855644</nova:name>
Nov 11 01:30:05 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:30:04</nova:creationTime>
Nov 11 01:30:05 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:30:05 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:30:05 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:30:05 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:30:05 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:30:05 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:30:05 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:30:05 user nova-compute[75215]:       <nova:owner>
Nov 11 01:30:05 user nova-compute[75215]:         <nova:user uuid="6269f798c52c45ee9ca9aa29a4487798">tempest-TaggedAttachmentsTest-1511763889-project-member</nova:user>
Nov 11 01:30:05 user nova-compute[75215]:         <nova:project uuid="e369e597968643269939d15256b6ae97">tempest-TaggedAttachmentsTest-1511763889</nova:project>
Nov 11 01:30:05 user nova-compute[75215]:       </nova:owner>
Nov 11 01:30:05 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:30:05 user nova-compute[75215]:       <nova:ports>
Nov 11 01:30:05 user nova-compute[75215]:         <nova:port uuid="997c39fb-7e21-4af1-acf2-e0e70157b02d">
Nov 11 01:30:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:30:05 user nova-compute[75215]:         </nova:port>
Nov 11 01:30:05 user nova-compute[75215]:       </nova:ports>
Nov 11 01:30:05 user nova-compute[75215]:     </nova:instance>
Nov 11 01:30:05 user nova-compute[75215]:   </metadata>
Nov 11 01:30:05 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:30:05 user nova-compute[75215]:     <system>
Nov 11 01:30:05 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:30:05 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:30:05 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:30:05 user nova-compute[75215]:       <entry name="serial">c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:30:05 user nova-compute[75215]:       <entry name="uuid">c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:30:05 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:30:05 user nova-compute[75215]:     </system>
Nov 11 01:30:05 user nova-compute[75215]:   </sysinfo>
Nov 11 01:30:05 user nova-compute[75215]:   <os>
Nov 11 01:30:05 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:30:05 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:30:05 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:30:05 user nova-compute[75215]:   </os>
Nov 11 01:30:05 user nova-compute[75215]:   <features>
Nov 11 01:30:05 user nova-compute[75215]:     <acpi/>
Nov 11 01:30:05 user nova-compute[75215]:     <apic/>
Nov 11 01:30:05 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:30:05 user nova-compute[75215]:   </features>
Nov 11 01:30:05 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:30:05 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:30:05 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:30:05 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:30:05 user nova-compute[75215]:   </clock>
Nov 11 01:30:05 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:30:05 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:30:05 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:30:05 user nova-compute[75215]:   </cpu>
Nov 11 01:30:05 user nova-compute[75215]:   <devices>
Nov 11 01:30:05 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:30:05 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:30:05 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk"/>
Nov 11 01:30:05 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:30:05 user nova-compute[75215]:     </disk>
Nov 11 01:30:05 user nova-compute[75215]:     <disk type="file" device="cdrom">
Nov 11 01:30:05 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none"/>
Nov 11 01:30:05 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.config"/>
Nov 11 01:30:05 user nova-compute[75215]:       <target dev="hda" bus="ide"/>
Nov 11 01:30:05 user nova-compute[75215]:     </disk>
Nov 11 01:30:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:30:05 user nova-compute[75215]:       <mac address="fa:16:3e:95:05:3a"/>
Nov 11 01:30:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:30:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:30:05 user nova-compute[75215]:       <target dev="tap997c39fb-7e"/>
Nov 11 01:30:05 user nova-compute[75215]:     </interface>
Nov 11 01:30:05 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:30:05 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log" append="off"/>
Nov 11 01:30:05 user nova-compute[75215]:     </serial>
Nov 11 01:30:05 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:30:05 user nova-compute[75215]:     <video>
Nov 11 01:30:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:30:05 user nova-compute[75215]:     </video>
Nov 11 01:30:05 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:30:05 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:30:05 user nova-compute[75215]:     </rng>
Nov 11 01:30:05 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:30:05 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:30:05 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:30:05 user nova-compute[75215]:     </memballoon>
Nov 11 01:30:05 user nova-compute[75215]:   </devices>
Nov 11 01:30:05 user nova-compute[75215]: </domain>
Nov 11 01:30:05 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converting VIF {"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=997c39fb-7e21-4af1-acf2-e0e70157b02d,network=Network(6915f72f-6c26-4506-a9b7-ab1baa663e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap997c39fb-7e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG os_vif [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=997c39fb-7e21-4af1-acf2-e0e70157b02d,network=Network(6915f72f-6c26-4506-a9b7-ab1baa663e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap997c39fb-7e') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52fcf2e4-4bbb-505b-8ce5-5c8fcfdf3064', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap997c39fb-7e, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap997c39fb-7e, col_values=(('qos', UUID('938f121c-a77e-4869-94fb-9219179df85f')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap997c39fb-7e, col_values=(('external_ids', {'iface-id': '997c39fb-7e21-4af1-acf2-e0e70157b02d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:05:3a', 'vm-uuid': 'c7c8d8f5-5e51-4e02-8001-ea843090f471'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:05 user nova-compute[75215]: INFO os_vif [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=997c39fb-7e21-4af1-acf2-e0e70157b02d,network=Network(6915f72f-6c26-4506-a9b7-ab1baa663e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap997c39fb-7e')
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No VIF found with MAC fa:16:3e:95:05:3a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:30:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Using config drive
Nov 11 01:30:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Creating config drive at /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.config
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7jtjld3j {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7jtjld3j" returned: 0 in 0.092s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Successfully created port: 9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:05 user nova-compute[75215]: WARNING nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state active and task_state None.
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received event network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] No waiting events found dispatching network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:05 user nova-compute[75215]: WARNING nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received unexpected event network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 for instance with vm_state active and task_state None.
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received event network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] No waiting events found dispatching network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:05 user nova-compute[75215]: WARNING nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received unexpected event network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 for instance with vm_state active and task_state None.
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received event network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] No waiting events found dispatching network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:05 user nova-compute[75215]: WARNING nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received unexpected event network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c for instance with vm_state active and task_state None.
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received event network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] No waiting events found dispatching network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:05 user nova-compute[75215]: WARNING nova.compute.manager [req-2765331e-054f-4d2c-a287-68840f8aeb65 req-37debe3e-7910-44ab-936e-71b3d6685f80 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received unexpected event network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c for instance with vm_state active and task_state None.
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-16162251-a8a2-4f20-90d8-741b1487f2da req-43e2569d-cf3e-4368-a509-c5e6db1da212 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updated VIF entry in instance network info cache for port 997c39fb-7e21-4af1-acf2-e0e70157b02d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-16162251-a8a2-4f20-90d8-741b1487f2da req-43e2569d-cf3e-4368-a509-c5e6db1da212 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating instance_info_cache with network_info: [{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-16162251-a8a2-4f20-90d8-741b1487f2da req-43e2569d-cf3e-4368-a509-c5e6db1da212 service nova] Releasing lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] No waiting events found dispatching network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:06 user nova-compute[75215]: WARNING nova.compute.manager [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received unexpected event network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac for instance with vm_state active and task_state None.
Nov 11 01:30:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] No waiting events found dispatching network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:06 user nova-compute[75215]: WARNING nova.compute.manager [req-4fcfc5a9-375a-4fcd-8aff-03ded229eda6 req-63dab19c-20ab-46ae-b8f1-cd196c49cf7f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received unexpected event network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac for instance with vm_state active and task_state None.
Nov 11 01:30:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-b015a565-4c45-498d-bacf-e4a3a2141dfc req-c8611266-2514-4f96-b95c-b83920f38fbb service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received event network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b015a565-4c45-498d-bacf-e4a3a2141dfc req-c8611266-2514-4f96-b95c-b83920f38fbb service nova] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b015a565-4c45-498d-bacf-e4a3a2141dfc req-c8611266-2514-4f96-b95c-b83920f38fbb service nova] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b015a565-4c45-498d-bacf-e4a3a2141dfc req-c8611266-2514-4f96-b95c-b83920f38fbb service nova] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-b015a565-4c45-498d-bacf-e4a3a2141dfc req-c8611266-2514-4f96-b95c-b83920f38fbb service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] No waiting events found dispatching network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:06 user nova-compute[75215]: WARNING nova.compute.manager [req-b015a565-4c45-498d-bacf-e4a3a2141dfc req-c8611266-2514-4f96-b95c-b83920f38fbb service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received unexpected event network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 for instance with vm_state active and task_state None.
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Successfully updated port: 9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquired lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Updating instance_info_cache with network_info: [{"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Releasing lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Instance network_info: |[{"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Start _get_guest_xml network_info=[{"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:30:07 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:30:07 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-de508cbc-0a7c-445f-a30f-3b6776a96582 req-0fde2000-6549-4e44-bf88-1ff12968eef2 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-de508cbc-0a7c-445f-a30f-3b6776a96582 req-0fde2000-6549-4e44-bf88-1ff12968eef2 service nova] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-de508cbc-0a7c-445f-a30f-3b6776a96582 req-0fde2000-6549-4e44-bf88-1ff12968eef2 service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-de508cbc-0a7c-445f-a30f-3b6776a96582 req-0fde2000-6549-4e44-bf88-1ff12968eef2 service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-de508cbc-0a7c-445f-a30f-3b6776a96582 req-0fde2000-6549-4e44-bf88-1ff12968eef2 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] No waiting events found dispatching network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:07 user nova-compute[75215]: WARNING nova.compute.manager [req-de508cbc-0a7c-445f-a30f-3b6776a96582 req-0fde2000-6549-4e44-bf88-1ff12968eef2 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received unexpected event network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d for instance with vm_state building and task_state spawning.
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1403311129',display_name='tempest-VolumesAssistedSnapshotsTest-server-1403311129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1403311129',id=9,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZmTg+DOi4RN5ggEz+IIuzljuHtgn0WykFbG90l787ReZKRbbVqgPKHzDwalGANCWEJWsoWI0GToXeAXR7NuWQ7D8pAZI77j7PxBDTbIu3C19aXyMdszc8erzMeSOEY8A==',key_name='tempest-keypair-825998623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4271fe9e96c4367b321196578f8dd20',ramdisk_id='',reservation_id='r-0mmtp3zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1475212709',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1475212709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387a12092fd94ce6816c35cb1dfe655c',uuid=a0456c90-8b61-44aa-9484-08d9a481f8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Converting VIF {"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:a6:85,bridge_name='br-int',has_traffic_filtering=True,id=9f846e49-33b9-4b5c-a170-258eeae8471f,network=Network(db589161-49d2-4749-9185-d0fc915149d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f846e49-33') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lazy-loading 'pci_devices' on Instance uuid a0456c90-8b61-44aa-9484-08d9a481f8a7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:30:07 user nova-compute[75215]:   <uuid>a0456c90-8b61-44aa-9484-08d9a481f8a7</uuid>
Nov 11 01:30:07 user nova-compute[75215]:   <name>instance-00000009</name>
Nov 11 01:30:07 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:30:07 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:30:07 user nova-compute[75215]:   <metadata>
Nov 11 01:30:07 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:30:07 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:30:07 user nova-compute[75215]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1403311129</nova:name>
Nov 11 01:30:07 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:30:07</nova:creationTime>
Nov 11 01:30:07 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:30:07 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:30:07 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:30:07 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:30:07 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:30:07 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:30:07 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:30:07 user nova-compute[75215]:       <nova:owner>
Nov 11 01:30:07 user nova-compute[75215]:         <nova:user uuid="387a12092fd94ce6816c35cb1dfe655c">tempest-VolumesAssistedSnapshotsTest-1475212709-project-member</nova:user>
Nov 11 01:30:07 user nova-compute[75215]:         <nova:project uuid="c4271fe9e96c4367b321196578f8dd20">tempest-VolumesAssistedSnapshotsTest-1475212709</nova:project>
Nov 11 01:30:07 user nova-compute[75215]:       </nova:owner>
Nov 11 01:30:07 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:30:07 user nova-compute[75215]:       <nova:ports>
Nov 11 01:30:07 user nova-compute[75215]:         <nova:port uuid="9f846e49-33b9-4b5c-a170-258eeae8471f">
Nov 11 01:30:07 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:30:07 user nova-compute[75215]:         </nova:port>
Nov 11 01:30:07 user nova-compute[75215]:       </nova:ports>
Nov 11 01:30:07 user nova-compute[75215]:     </nova:instance>
Nov 11 01:30:07 user nova-compute[75215]:   </metadata>
Nov 11 01:30:07 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:30:07 user nova-compute[75215]:     <system>
Nov 11 01:30:07 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:30:07 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:30:07 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:30:07 user nova-compute[75215]:       <entry name="serial">a0456c90-8b61-44aa-9484-08d9a481f8a7</entry>
Nov 11 01:30:07 user nova-compute[75215]:       <entry name="uuid">a0456c90-8b61-44aa-9484-08d9a481f8a7</entry>
Nov 11 01:30:07 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:30:07 user nova-compute[75215]:     </system>
Nov 11 01:30:07 user nova-compute[75215]:   </sysinfo>
Nov 11 01:30:07 user nova-compute[75215]:   <os>
Nov 11 01:30:07 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:30:07 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:30:07 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:30:07 user nova-compute[75215]:   </os>
Nov 11 01:30:07 user nova-compute[75215]:   <features>
Nov 11 01:30:07 user nova-compute[75215]:     <acpi/>
Nov 11 01:30:07 user nova-compute[75215]:     <apic/>
Nov 11 01:30:07 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:30:07 user nova-compute[75215]:   </features>
Nov 11 01:30:07 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:30:07 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:30:07 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:30:07 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:30:07 user nova-compute[75215]:   </clock>
Nov 11 01:30:07 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:30:07 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:30:07 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:30:07 user nova-compute[75215]:   </cpu>
Nov 11 01:30:07 user nova-compute[75215]:   <devices>
Nov 11 01:30:07 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:30:07 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:30:07 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk"/>
Nov 11 01:30:07 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:30:07 user nova-compute[75215]:     </disk>
Nov 11 01:30:07 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:30:07 user nova-compute[75215]:       <mac address="fa:16:3e:00:a6:85"/>
Nov 11 01:30:07 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:30:07 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:30:07 user nova-compute[75215]:       <target dev="tap9f846e49-33"/>
Nov 11 01:30:07 user nova-compute[75215]:     </interface>
Nov 11 01:30:07 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:30:07 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/console.log" append="off"/>
Nov 11 01:30:07 user nova-compute[75215]:     </serial>
Nov 11 01:30:07 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:30:07 user nova-compute[75215]:     <video>
Nov 11 01:30:07 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:30:07 user nova-compute[75215]:     </video>
Nov 11 01:30:07 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:30:07 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:30:07 user nova-compute[75215]:     </rng>
Nov 11 01:30:07 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:30:07 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:30:07 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:30:07 user nova-compute[75215]:     </memballoon>
Nov 11 01:30:07 user nova-compute[75215]:   </devices>
Nov 11 01:30:07 user nova-compute[75215]: </domain>
Nov 11 01:30:07 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1403311129',display_name='tempest-VolumesAssistedSnapshotsTest-server-1403311129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1403311129',id=9,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZmTg+DOi4RN5ggEz+IIuzljuHtgn0WykFbG90l787ReZKRbbVqgPKHzDwalGANCWEJWsoWI0GToXeAXR7NuWQ7D8pAZI77j7PxBDTbIu3C19aXyMdszc8erzMeSOEY8A==',key_name='tempest-keypair-825998623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4271fe9e96c4367b321196578f8dd20',ramdisk_id='',reservation_id='r-0mmtp3zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1475212709',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1475212709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387a12092fd94ce6816c35cb1dfe655c',uuid=a0456c90-8b61-44aa-9484-08d9a481f8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Converting VIF {"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:a6:85,bridge_name='br-int',has_traffic_filtering=True,id=9f846e49-33b9-4b5c-a170-258eeae8471f,network=Network(db589161-49d2-4749-9185-d0fc915149d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f846e49-33') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG os_vif [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:a6:85,bridge_name='br-int',has_traffic_filtering=True,id=9f846e49-33b9-4b5c-a170-258eeae8471f,network=Network(db589161-49d2-4749-9185-d0fc915149d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f846e49-33') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10b8c8cc-d813-510f-94a3-7d3ac7098dbc', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f846e49-33, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f846e49-33, col_values=(('qos', UUID('ed99e8b9-9a5e-4131-99dc-0c2422204331')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f846e49-33, col_values=(('external_ids', {'iface-id': '9f846e49-33b9-4b5c-a170-258eeae8471f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:a6:85', 'vm-uuid': 'a0456c90-8b61-44aa-9484-08d9a481f8a7'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:30:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:07 user nova-compute[75215]: INFO os_vif [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:a6:85,bridge_name='br-int',has_traffic_filtering=True,id=9f846e49-33b9-4b5c-a170-258eeae8471f,network=Network(db589161-49d2-4749-9185-d0fc915149d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f846e49-33')
Nov 11 01:30:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] No VIF found with MAC fa:16:3e:00:a6:85, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-c5c50c0f-13b0-4032-b691-d5c78c1f2e72 req-7d361223-dbb3-4199-ac69-7b14271eb8bc service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received event network-changed-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-c5c50c0f-13b0-4032-b691-d5c78c1f2e72 req-7d361223-dbb3-4199-ac69-7b14271eb8bc service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Refreshing instance network info cache due to event network-changed-9f846e49-33b9-4b5c-a170-258eeae8471f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5c50c0f-13b0-4032-b691-d5c78c1f2e72 req-7d361223-dbb3-4199-ac69-7b14271eb8bc service nova] Acquiring lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5c50c0f-13b0-4032-b691-d5c78c1f2e72 req-7d361223-dbb3-4199-ac69-7b14271eb8bc service nova] Acquired lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-c5c50c0f-13b0-4032-b691-d5c78c1f2e72 req-7d361223-dbb3-4199-ac69-7b14271eb8bc service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Refreshing network info cache for port 9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:30:08 user nova-compute[75215]: INFO nova.compute.claims [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Claim successful on node user
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.network.neutron [req-c5c50c0f-13b0-4032-b691-d5c78c1f2e72 req-7d361223-dbb3-4199-ac69-7b14271eb8bc service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Updated VIF entry in instance network info cache for port 9f846e49-33b9-4b5c-a170-258eeae8471f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.network.neutron [req-c5c50c0f-13b0-4032-b691-d5c78c1f2e72 req-7d361223-dbb3-4199-ac69-7b14271eb8bc service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Updating instance_info_cache with network_info: [{"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c5c50c0f-13b0-4032-b691-d5c78c1f2e72 req-7d361223-dbb3-4199-ac69-7b14271eb8bc service nova] Releasing lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-029bae37-6f5d-4082-827e-e9b99cdb5490 req-92120b40-54ee-4e75-847d-984c54b48aa5 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received event network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-029bae37-6f5d-4082-827e-e9b99cdb5490 req-92120b40-54ee-4e75-847d-984c54b48aa5 service nova] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-029bae37-6f5d-4082-827e-e9b99cdb5490 req-92120b40-54ee-4e75-847d-984c54b48aa5 service nova] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-029bae37-6f5d-4082-827e-e9b99cdb5490 req-92120b40-54ee-4e75-847d-984c54b48aa5 service nova] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-029bae37-6f5d-4082-827e-e9b99cdb5490 req-92120b40-54ee-4e75-847d-984c54b48aa5 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] No waiting events found dispatching network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:09 user nova-compute[75215]: WARNING nova.compute.manager [req-029bae37-6f5d-4082-827e-e9b99cdb5490 req-92120b40-54ee-4e75-847d-984c54b48aa5 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received unexpected event network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 for instance with vm_state active and task_state None.
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.policy [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b44d25dd39a648a6b19fda84ab4f77d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fec73efbde4bd5a39d6c8866695f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:30:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Creating image(s)
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "/opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "/opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "/opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-0023d758-f5a7-4a3c-a392-4fac7b198a01 req-e0885817-eb3f-4e4f-b3e2-b3616c92163b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0023d758-f5a7-4a3c-a392-4fac7b198a01 req-e0885817-eb3f-4e4f-b3e2-b3616c92163b service nova] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0023d758-f5a7-4a3c-a392-4fac7b198a01 req-e0885817-eb3f-4e4f-b3e2-b3616c92163b service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0023d758-f5a7-4a3c-a392-4fac7b198a01 req-e0885817-eb3f-4e4f-b3e2-b3616c92163b service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-0023d758-f5a7-4a3c-a392-4fac7b198a01 req-e0885817-eb3f-4e4f-b3e2-b3616c92163b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] No waiting events found dispatching network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:09 user nova-compute[75215]: WARNING nova.compute.manager [req-0023d758-f5a7-4a3c-a392-4fac7b198a01 req-e0885817-eb3f-4e4f-b3e2-b3616c92163b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received unexpected event network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d for instance with vm_state building and task_state spawning.
Nov 11 01:30:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:30:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Instance spawned successfully.
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.405s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:10 user nova-compute[75215]: INFO nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Took 9.06 seconds to spawn the instance on the hypervisor.
Nov 11 01:30:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.298s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:10 user nova-compute[75215]: INFO nova.compute.manager [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Took 10.76 seconds to build instance.
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk 1073741824" returned: 0 in 0.071s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-178a2a3b-9824-40c5-95ed-22731b0c1425 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.967s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Successfully created port: 21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.286s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:30:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Cannot resize image /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Ensure instance console log exists: /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Successfully updated port: 21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquired lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-864e2a9b-654c-4eea-82cc-e64a0fce84c2 req-1fc0e338-01c8-4382-b0b6-36fc86c21865 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received event network-changed-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-864e2a9b-654c-4eea-82cc-e64a0fce84c2 req-1fc0e338-01c8-4382-b0b6-36fc86c21865 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Refreshing instance network info cache due to event network-changed-21229308-4609-4594-9c02-2d5a73c7ce1d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-864e2a9b-654c-4eea-82cc-e64a0fce84c2 req-1fc0e338-01c8-4382-b0b6-36fc86c21865 service nova] Acquiring lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received event network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] No waiting events found dispatching network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:11 user nova-compute[75215]: WARNING nova.compute.manager [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received unexpected event network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f for instance with vm_state building and task_state spawning.
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received event network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] No waiting events found dispatching network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:11 user nova-compute[75215]: WARNING nova.compute.manager [req-cd39a599-55b8-47c8-893e-24208308d5b0 req-36da7ad5-fc9d-44d5-b6da-b6e87d973eba service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received unexpected event network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f for instance with vm_state building and task_state spawning.
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updating instance_info_cache with network_info: [{"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Releasing lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Instance network_info: |[{"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-864e2a9b-654c-4eea-82cc-e64a0fce84c2 req-1fc0e338-01c8-4382-b0b6-36fc86c21865 service nova] Acquired lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-864e2a9b-654c-4eea-82cc-e64a0fce84c2 req-1fc0e338-01c8-4382-b0b6-36fc86c21865 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Refreshing network info cache for port 21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Start _get_guest_xml network_info=[{"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:30:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1552407209',display_name='tempest-TestVolumeSwap-server-1552407209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1552407209',id=10,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZJo0sytZC5IuoBSO51eVpwoSmnt6kmQDIKh8Ye5Ab0lhOxDmzwUvgsU/3gLSeO4Bk3Hsg73WxJyTs2ftetZanHF7N+fN4vPzzQKX3Kx9AopbzsbLgbFDeHBSY7NuITsQ==',key_name='tempest-keypair-1351573152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fec73efbde4bd5a39d6c8866695f7c',ramdisk_id='',reservation_id='r-otaf22nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-923187612',owner_user_name='tempest-TestVolumeSwap-923187612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44d25dd39a648a6b19fda84ab4f77d3',uuid=b58b0c19-8c8a-482b-a693-eb6855ed5dd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Converting VIF {"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:2c,bridge_name='br-int',has_traffic_filtering=True,id=21229308-4609-4594-9c02-2d5a73c7ce1d,network=Network(7ab6f502-899a-46a6-9fdc-7245305ba4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21229308-46') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.objects.instance [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lazy-loading 'pci_devices' on Instance uuid b58b0c19-8c8a-482b-a693-eb6855ed5dd1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:30:12 user nova-compute[75215]:   <uuid>b58b0c19-8c8a-482b-a693-eb6855ed5dd1</uuid>
Nov 11 01:30:12 user nova-compute[75215]:   <name>instance-0000000a</name>
Nov 11 01:30:12 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:30:12 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:30:12 user nova-compute[75215]:   <metadata>
Nov 11 01:30:12 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:30:12 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:30:12 user nova-compute[75215]:       <nova:name>tempest-TestVolumeSwap-server-1552407209</nova:name>
Nov 11 01:30:12 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:30:12</nova:creationTime>
Nov 11 01:30:12 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:30:12 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:30:12 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:30:12 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:30:12 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:30:12 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:30:12 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:30:12 user nova-compute[75215]:       <nova:owner>
Nov 11 01:30:12 user nova-compute[75215]:         <nova:user uuid="b44d25dd39a648a6b19fda84ab4f77d3">tempest-TestVolumeSwap-923187612-project-member</nova:user>
Nov 11 01:30:12 user nova-compute[75215]:         <nova:project uuid="06fec73efbde4bd5a39d6c8866695f7c">tempest-TestVolumeSwap-923187612</nova:project>
Nov 11 01:30:12 user nova-compute[75215]:       </nova:owner>
Nov 11 01:30:12 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:30:12 user nova-compute[75215]:       <nova:ports>
Nov 11 01:30:12 user nova-compute[75215]:         <nova:port uuid="21229308-4609-4594-9c02-2d5a73c7ce1d">
Nov 11 01:30:12 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 01:30:12 user nova-compute[75215]:         </nova:port>
Nov 11 01:30:12 user nova-compute[75215]:       </nova:ports>
Nov 11 01:30:12 user nova-compute[75215]:     </nova:instance>
Nov 11 01:30:12 user nova-compute[75215]:   </metadata>
Nov 11 01:30:12 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:30:12 user nova-compute[75215]:     <system>
Nov 11 01:30:12 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:30:12 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:30:12 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:30:12 user nova-compute[75215]:       <entry name="serial">b58b0c19-8c8a-482b-a693-eb6855ed5dd1</entry>
Nov 11 01:30:12 user nova-compute[75215]:       <entry name="uuid">b58b0c19-8c8a-482b-a693-eb6855ed5dd1</entry>
Nov 11 01:30:12 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:30:12 user nova-compute[75215]:     </system>
Nov 11 01:30:12 user nova-compute[75215]:   </sysinfo>
Nov 11 01:30:12 user nova-compute[75215]:   <os>
Nov 11 01:30:12 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:30:12 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:30:12 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:30:12 user nova-compute[75215]:   </os>
Nov 11 01:30:12 user nova-compute[75215]:   <features>
Nov 11 01:30:12 user nova-compute[75215]:     <acpi/>
Nov 11 01:30:12 user nova-compute[75215]:     <apic/>
Nov 11 01:30:12 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:30:12 user nova-compute[75215]:   </features>
Nov 11 01:30:12 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:30:12 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:30:12 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:30:12 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:30:12 user nova-compute[75215]:   </clock>
Nov 11 01:30:12 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:30:12 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:30:12 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:30:12 user nova-compute[75215]:   </cpu>
Nov 11 01:30:12 user nova-compute[75215]:   <devices>
Nov 11 01:30:12 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:30:12 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:30:12 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk"/>
Nov 11 01:30:12 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:30:12 user nova-compute[75215]:     </disk>
Nov 11 01:30:12 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:30:12 user nova-compute[75215]:       <mac address="fa:16:3e:6d:40:2c"/>
Nov 11 01:30:12 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:30:12 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:30:12 user nova-compute[75215]:       <target dev="tap21229308-46"/>
Nov 11 01:30:12 user nova-compute[75215]:     </interface>
Nov 11 01:30:12 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:30:12 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/console.log" append="off"/>
Nov 11 01:30:12 user nova-compute[75215]:     </serial>
Nov 11 01:30:12 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:30:12 user nova-compute[75215]:     <video>
Nov 11 01:30:12 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:30:12 user nova-compute[75215]:     </video>
Nov 11 01:30:12 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:30:12 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:30:12 user nova-compute[75215]:     </rng>
Nov 11 01:30:12 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:30:12 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:30:12 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:30:12 user nova-compute[75215]:     </memballoon>
Nov 11 01:30:12 user nova-compute[75215]:   </devices>
Nov 11 01:30:12 user nova-compute[75215]: </domain>
Nov 11 01:30:12 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1552407209',display_name='tempest-TestVolumeSwap-server-1552407209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1552407209',id=10,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZJo0sytZC5IuoBSO51eVpwoSmnt6kmQDIKh8Ye5Ab0lhOxDmzwUvgsU/3gLSeO4Bk3Hsg73WxJyTs2ftetZanHF7N+fN4vPzzQKX3Kx9AopbzsbLgbFDeHBSY7NuITsQ==',key_name='tempest-keypair-1351573152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fec73efbde4bd5a39d6c8866695f7c',ramdisk_id='',reservation_id='r-otaf22nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-923187612',owner_user_name='tempest-TestVolumeSwap-923187612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44d25dd39a648a6b19fda84ab4f77d3',uuid=b58b0c19-8c8a-482b-a693-eb6855ed5dd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Converting VIF {"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:2c,bridge_name='br-int',has_traffic_filtering=True,id=21229308-4609-4594-9c02-2d5a73c7ce1d,network=Network(7ab6f502-899a-46a6-9fdc-7245305ba4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21229308-46') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG os_vif [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:2c,bridge_name='br-int',has_traffic_filtering=True,id=21229308-4609-4594-9c02-2d5a73c7ce1d,network=Network(7ab6f502-899a-46a6-9fdc-7245305ba4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21229308-46') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dc1a0c2-9608-539e-a13c-54a7ef46ce58', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21229308-46, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21229308-46, col_values=(('qos', UUID('5b149ee4-b14b-47e4-bdb2-98c99b0e9c99')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21229308-46, col_values=(('external_ids', {'iface-id': '21229308-4609-4594-9c02-2d5a73c7ce1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:40:2c', 'vm-uuid': 'b58b0c19-8c8a-482b-a693-eb6855ed5dd1'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:12 user nova-compute[75215]: INFO os_vif [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:40:2c,bridge_name='br-int',has_traffic_filtering=True,id=21229308-4609-4594-9c02-2d5a73c7ce1d,network=Network(7ab6f502-899a-46a6-9fdc-7245305ba4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21229308-46')
Nov 11 01:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.362s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] No VIF found with MAC fa:16:3e:6d:40:2c, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:30:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Instance spawned successfully.
Nov 11 01:30:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-864e2a9b-654c-4eea-82cc-e64a0fce84c2 req-1fc0e338-01c8-4382-b0b6-36fc86c21865 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updated VIF entry in instance network info cache for port 21229308-4609-4594-9c02-2d5a73c7ce1d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-864e2a9b-654c-4eea-82cc-e64a0fce84c2 req-1fc0e338-01c8-4382-b0b6-36fc86c21865 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updating instance_info_cache with network_info: [{"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:13 user nova-compute[75215]: INFO nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Took 9.13 seconds to spawn the instance on the hypervisor.
Nov 11 01:30:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-864e2a9b-654c-4eea-82cc-e64a0fce84c2 req-1fc0e338-01c8-4382-b0b6-36fc86c21865 service nova] Releasing lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:13 user nova-compute[75215]: INFO nova.compute.manager [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Took 11.31 seconds to build instance.
Nov 11 01:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-730b50fa-1817-403d-9fa7-8290a460b595 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.491s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-9ed96085-6e21-4912-994e-6a73b65effa0 req-037fc361-bdd7-47e2-bb2d-ac46de7107eb service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received event network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9ed96085-6e21-4912-994e-6a73b65effa0 req-037fc361-bdd7-47e2-bb2d-ac46de7107eb service nova] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9ed96085-6e21-4912-994e-6a73b65effa0 req-037fc361-bdd7-47e2-bb2d-ac46de7107eb service nova] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9ed96085-6e21-4912-994e-6a73b65effa0 req-037fc361-bdd7-47e2-bb2d-ac46de7107eb service nova] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-9ed96085-6e21-4912-994e-6a73b65effa0 req-037fc361-bdd7-47e2-bb2d-ac46de7107eb service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] No waiting events found dispatching network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:15 user nova-compute[75215]: WARNING nova.compute.manager [req-9ed96085-6e21-4912-994e-6a73b65effa0 req-037fc361-bdd7-47e2-bb2d-ac46de7107eb service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received unexpected event network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d for instance with vm_state building and task_state spawning.
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-ba6552bd-b399-4158-ac24-438bcf0a0ba3 req-52e12426-7bff-42fb-832f-c3840e13680c service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received event network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ba6552bd-b399-4158-ac24-438bcf0a0ba3 req-52e12426-7bff-42fb-832f-c3840e13680c service nova] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ba6552bd-b399-4158-ac24-438bcf0a0ba3 req-52e12426-7bff-42fb-832f-c3840e13680c service nova] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ba6552bd-b399-4158-ac24-438bcf0a0ba3 req-52e12426-7bff-42fb-832f-c3840e13680c service nova] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-ba6552bd-b399-4158-ac24-438bcf0a0ba3 req-52e12426-7bff-42fb-832f-c3840e13680c service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] No waiting events found dispatching network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:30:17 user nova-compute[75215]: WARNING nova.compute.manager [req-ba6552bd-b399-4158-ac24-438bcf0a0ba3 req-52e12426-7bff-42fb-832f-c3840e13680c service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received unexpected event network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d for instance with vm_state building and task_state spawning.
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:30:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=25.711170196533203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Instance spawned successfully.
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:30:17 user nova-compute[75215]: INFO nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Took 8.02 seconds to spawn the instance on the hypervisor.
Nov 11 01:30:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:30:17 user nova-compute[75215]: INFO nova.compute.manager [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Took 9.17 seconds to build instance.
Nov 11 01:30:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5ab10853-0a91-45b1-8e9d-34a0fcb1f83e tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.324s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance fb579a71-869d-41ce-9572-4f87a11378fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c7c8d8f5-5e51-4e02-8001-ea843090f471 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a0456c90-8b61-44aa-9484-08d9a481f8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:30:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.134s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:30:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:30:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:30:19 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 330defc6-9b43-4f1e-9a76-94b23750e1b0 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updating instance_info_cache with network_info: [{"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:30:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:30:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:30:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:30:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:30:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:30:46 user nova-compute[75215]: INFO nova.compute.claims [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Claim successful on node user
Nov 11 01:30:47 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:30:47 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:30:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:30:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:30:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:30:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:30:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:30:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:30:47 user nova-compute[75215]: DEBUG nova.policy [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adb61d2710ea47d587e79463829c8a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197414e73eb4e288859873fdfbff020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:30:47 user nova-compute[75215]: INFO nova.virt.block_device [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Booting with volume 02bab4fc-3d0f-449a-b7a0-ef86c368498c at /dev/vda
Nov 11 01:30:47 user nova-compute[75215]: DEBUG os_brick.utils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:30:47 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6ylfly6l/privsep.sock']
Nov 11 01:30:47 user sudo[86642]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6ylfly6l/privsep.sock
Nov 11 01:30:47 user sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 11 01:30:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Successfully created port: 61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Successfully updated port: 61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquired lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-e8992d33-5fc0-46b1-b0b3-eef690d43532 req-20874498-f46f-42b2-a983-91674938dbf7 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received event network-changed-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-e8992d33-5fc0-46b1-b0b3-eef690d43532 req-20874498-f46f-42b2-a983-91674938dbf7 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Refreshing instance network info cache due to event network-changed-61201a0d-3ca2-4630-8fda-8296efd0325e. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8992d33-5fc0-46b1-b0b3-eef690d43532 req-20874498-f46f-42b2-a983-91674938dbf7 service nova] Acquiring lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Updating instance_info_cache with network_info: [{"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Releasing lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Instance network_info: |[{"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8992d33-5fc0-46b1-b0b3-eef690d43532 req-20874498-f46f-42b2-a983-91674938dbf7 service nova] Acquired lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:30:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-e8992d33-5fc0-46b1-b0b3-eef690d43532 req-20874498-f46f-42b2-a983-91674938dbf7 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Refreshing network info cache for port 61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:30:49 user sudo[86642]: pam_unix(sudo:session): session closed for user root
Nov 11 01:30:49 user nova-compute[75215]: INFO oslo.privsep.daemon [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Spawned new privsep daemon via rootwrap
Nov 11 01:30:49 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 11 01:30:49 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 11 01:30:49 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 11 01:30:49 user nova-compute[75215]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86647
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf08201-e0f1-4b30-9b0b-3f7510bac871]: (2,) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea4c34-2fab-4748-8a61-ea047ff74cbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:30:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.nvmeof [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47b8d60-9cc4-464c-981d-3f4f530808fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d639078b-56ed-4fde-ad13-672a5343f59d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f8e6a-69d4-48b3-b216-d623edaa2dee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:30:49 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3067fef-1fb9-484c-a5d2-9b03ab100c18]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG os_brick.utils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] <== get_connector_properties: return (1806ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Updating existing volume attachment record: dea12554-816e-4da9-bf23-200da736c597 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-e8992d33-5fc0-46b1-b0b3-eef690d43532 req-20874498-f46f-42b2-a983-91674938dbf7 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Updated VIF entry in instance network info cache for port 61201a0d-3ca2-4630-8fda-8296efd0325e. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-e8992d33-5fc0-46b1-b0b3-eef690d43532 req-20874498-f46f-42b2-a983-91674938dbf7 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Updating instance_info_cache with network_info: [{"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:30:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8992d33-5fc0-46b1-b0b3-eef690d43532 req-20874498-f46f-42b2-a983-91674938dbf7 service nova] Releasing lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:30:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:30:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:30:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:30:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:30:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:30:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:31:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:31:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:31:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:31:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:31:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Creating image(s)
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Ensure instance console log exists: /opt/stack/data/nova/instances/ed9354d9-106b-4ca5-8f60-0140c85e74ca/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Start _get_guest_xml network_info=[{"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'dea12554-816e-4da9-bf23-200da736c597', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uahLfXcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed9354d9-106b-4ca5-8f60-0140c85e74ca', 'attached_at': '', 'detached_at': '', 'volume_id': '02bab4fc-3d0f-449a-b7a0-ef86c368498c', 'serial': '02bab4fc-3d0f-449a-b7a0-ef86c368498c'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:31:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connector [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Factory for ISCSI on None {{(pid=75215) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uahLfXcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:31:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:31:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:31:13 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaef309-37d4-4a1b-8bb7-506ad9cc7091]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:31:13 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daf7cf7-ddaf-49f9-aac1-e3cadad12193]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c] added
Nov 11 01:31:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcc9541-2209-4b19-837f-c5e70cc5e9ed]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f7d56c-d868-4c73-8e30-fd495b6b92d7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uahLfXcl {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uahLfXcl" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a72f78-4cea-444e-bdc8-96ad167cfd12]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uahLfXcl'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a62b5b0-e6f2-441d-ab69-37bca4d95295]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9079f8a-e013-4c73-ad72-e045b9d8f221]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 01:31:14 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 01:31:14 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:31:14 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 01:31:14 user nova-compute[75215]: 
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e245048-2b56-4402-bdf7-f43b32659d25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c, portal: 172.16.0.220,3260]
Nov 11 01:31:14 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c, portal: 172.16.0.220,3260] successful.
Nov 11 01:31:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1975b1-db2e-42fd-8797-6449b589e703]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f7bd40-ba90-4a95-a69e-81f5fa0ffc6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:31:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:31:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3858ff45-fbf9-44a1-aaf6-49a728b062b1]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uahLfXcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:31:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7125MB free_disk=25.573673248291016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26363643462643939', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363643462643939', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance fb579a71-869d-41ce-9572-4f87a11378fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c7c8d8f5-5e51-4e02-8001-ea843090f471 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a0456c90-8b61-44aa-9484-08d9a481f8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2101150845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2101150845',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI4xbc95iRypDAXtYtVCO2XHcCPICwFh7x9vwaMc7ulWk0+0mVr9rQal/5zIvQw6Njf9/8Y5wXTBvl/liRgZNXAw1KwVINNL356/u7AJIV/xrZ/d2bCck0lMCyf6SxzlQ==',key_name='tempest-keypair-112562791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0197414e73eb4e288859873fdfbff020',ramdisk_id='',reservation_id='r-5y9diyza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-470050517',owner_user_name='tempest-ServerActionsV293TestJSON-470050517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb61d2710ea47d587e79463829c8a3e',uuid=ed9354d9-106b-4ca5-8f60-0140c85e74ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Converting VIF {"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lazy-loading 'pci_devices' on Instance uuid ed9354d9-106b-4ca5-8f60-0140c85e74ca {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:31:15 user nova-compute[75215]:   <uuid>ed9354d9-106b-4ca5-8f60-0140c85e74ca</uuid>
Nov 11 01:31:15 user nova-compute[75215]:   <name>instance-0000000b</name>
Nov 11 01:31:15 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:31:15 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:31:15 user nova-compute[75215]:   <metadata>
Nov 11 01:31:15 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:31:15 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:31:15 user nova-compute[75215]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2101150845</nova:name>
Nov 11 01:31:15 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:31:13</nova:creationTime>
Nov 11 01:31:15 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:31:15 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:31:15 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:31:15 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:31:15 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:31:15 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:31:15 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:31:15 user nova-compute[75215]:       <nova:owner>
Nov 11 01:31:15 user nova-compute[75215]:         <nova:user uuid="adb61d2710ea47d587e79463829c8a3e">tempest-ServerActionsV293TestJSON-470050517-project-member</nova:user>
Nov 11 01:31:15 user nova-compute[75215]:         <nova:project uuid="0197414e73eb4e288859873fdfbff020">tempest-ServerActionsV293TestJSON-470050517</nova:project>
Nov 11 01:31:15 user nova-compute[75215]:       </nova:owner>
Nov 11 01:31:15 user nova-compute[75215]:       <nova:ports>
Nov 11 01:31:15 user nova-compute[75215]:         <nova:port uuid="61201a0d-3ca2-4630-8fda-8296efd0325e">
Nov 11 01:31:15 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 11 01:31:15 user nova-compute[75215]:         </nova:port>
Nov 11 01:31:15 user nova-compute[75215]:       </nova:ports>
Nov 11 01:31:15 user nova-compute[75215]:     </nova:instance>
Nov 11 01:31:15 user nova-compute[75215]:   </metadata>
Nov 11 01:31:15 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:31:15 user nova-compute[75215]:     <system>
Nov 11 01:31:15 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:31:15 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:31:15 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:31:15 user nova-compute[75215]:       <entry name="serial">ed9354d9-106b-4ca5-8f60-0140c85e74ca</entry>
Nov 11 01:31:15 user nova-compute[75215]:       <entry name="uuid">ed9354d9-106b-4ca5-8f60-0140c85e74ca</entry>
Nov 11 01:31:15 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:31:15 user nova-compute[75215]:     </system>
Nov 11 01:31:15 user nova-compute[75215]:   </sysinfo>
Nov 11 01:31:15 user nova-compute[75215]:   <os>
Nov 11 01:31:15 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:31:15 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:31:15 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:31:15 user nova-compute[75215]:   </os>
Nov 11 01:31:15 user nova-compute[75215]:   <features>
Nov 11 01:31:15 user nova-compute[75215]:     <acpi/>
Nov 11 01:31:15 user nova-compute[75215]:     <apic/>
Nov 11 01:31:15 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:31:15 user nova-compute[75215]:   </features>
Nov 11 01:31:15 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:31:15 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:31:15 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:31:15 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:31:15 user nova-compute[75215]:   </clock>
Nov 11 01:31:15 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:31:15 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:31:15 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:31:15 user nova-compute[75215]:   </cpu>
Nov 11 01:31:15 user nova-compute[75215]:   <devices>
Nov 11 01:31:15 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:31:15 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:31:15 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 11 01:31:15 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:31:15 user nova-compute[75215]:       <serial>02bab4fc-3d0f-449a-b7a0-ef86c368498c</serial>
Nov 11 01:31:15 user nova-compute[75215]:     </disk>
Nov 11 01:31:15 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:31:15 user nova-compute[75215]:       <mac address="fa:16:3e:d5:46:b5"/>
Nov 11 01:31:15 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:31:15 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:31:15 user nova-compute[75215]:       <target dev="tap61201a0d-3c"/>
Nov 11 01:31:15 user nova-compute[75215]:     </interface>
Nov 11 01:31:15 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:31:15 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ed9354d9-106b-4ca5-8f60-0140c85e74ca/console.log" append="off"/>
Nov 11 01:31:15 user nova-compute[75215]:     </serial>
Nov 11 01:31:15 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:31:15 user nova-compute[75215]:     <video>
Nov 11 01:31:15 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:31:15 user nova-compute[75215]:     </video>
Nov 11 01:31:15 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:31:15 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:31:15 user nova-compute[75215]:     </rng>
Nov 11 01:31:15 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:31:15 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:31:15 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:31:15 user nova-compute[75215]:     </memballoon>
Nov 11 01:31:15 user nova-compute[75215]:   </devices>
Nov 11 01:31:15 user nova-compute[75215]: </domain>
Nov 11 01:31:15 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2101150845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2101150845',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI4xbc95iRypDAXtYtVCO2XHcCPICwFh7x9vwaMc7ulWk0+0mVr9rQal/5zIvQw6Njf9/8Y5wXTBvl/liRgZNXAw1KwVINNL356/u7AJIV/xrZ/d2bCck0lMCyf6SxzlQ==',key_name='tempest-keypair-112562791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0197414e73eb4e288859873fdfbff020',ramdisk_id='',reservation_id='r-5y9diyza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-470050517',owner_user_name='tempest-ServerActionsV293TestJSON-470050517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb61d2710ea47d587e79463829c8a3e',uuid=ed9354d9-106b-4ca5-8f60-0140c85e74ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Converting VIF {"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG os_vif [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:31:15 user nova-compute[75215]: INFO nova.compute.manager [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] instance snapshotting
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ab68619-0ee3-5cd0-8f50-069488ed15aa', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61201a0d-3c, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61201a0d-3c, col_values=(('qos', UUID('7e4e555f-60a5-4b27-8f8c-dcbbfdec47a1')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61201a0d-3c, col_values=(('external_ids', {'iface-id': '61201a0d-3ca2-4630-8fda-8296efd0325e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:46:b5', 'vm-uuid': 'ed9354d9-106b-4ca5-8f60-0140c85e74ca'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:15 user nova-compute[75215]: INFO os_vif [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c')
Nov 11 01:31:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Beginning live snapshot process
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] No VIF found with MAC fa:16:3e:d5:46:b5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-bd56b4d8-4448-45c5-ba15-0e3b91693489 req-11862c2c-e090-4374-a789-139a51678254 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received event network-changed-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-bd56b4d8-4448-45c5-ba15-0e3b91693489 req-11862c2c-e090-4374-a789-139a51678254 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Refreshing instance network info cache due to event network-changed-2771b3b6-1454-4fae-bfc8-3c1c803324b0. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd56b4d8-4448-45c5-ba15-0e3b91693489 req-11862c2c-e090-4374-a789-139a51678254 service nova] Acquiring lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd56b4d8-4448-45c5-ba15-0e3b91693489 req-11862c2c-e090-4374-a789-139a51678254 service nova] Acquired lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-bd56b4d8-4448-45c5-ba15-0e3b91693489 req-11862c2c-e090-4374-a789-139a51678254 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Refreshing network info cache for port 2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG nova.network.neutron [req-bd56b4d8-4448-45c5-ba15-0e3b91693489 req-11862c2c-e090-4374-a789-139a51678254 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updated VIF entry in instance network info cache for port 2771b3b6-1454-4fae-bfc8-3c1c803324b0. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG nova.network.neutron [req-bd56b4d8-4448-45c5-ba15-0e3b91693489 req-11862c2c-e090-4374-a789-139a51678254 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updating instance_info_cache with network_info: [{"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd56b4d8-4448-45c5-ba15-0e3b91693489 req-11862c2c-e090-4374-a789-139a51678254 service nova] Releasing lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzxv0h6xl/6d3192ffc5ae4122ad29eeaa6972f18c.delta 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzxv0h6xl/6d3192ffc5ae4122ad29eeaa6972f18c.delta 1073741824" returned: 0 in 0.045s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 11 01:31:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75215) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 11 01:31:16 user nova-compute[75215]: INFO nova.virt.libvirt.host [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] UEFI support detected
Nov 11 01:31:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-35880aed-3d47-40d0-903d-0dd054e56930 req-4a0cb0d8-08c1-4c5d-9cdd-a39aa375de9e service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received event network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-35880aed-3d47-40d0-903d-0dd054e56930 req-4a0cb0d8-08c1-4c5d-9cdd-a39aa375de9e service nova] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-35880aed-3d47-40d0-903d-0dd054e56930 req-4a0cb0d8-08c1-4c5d-9cdd-a39aa375de9e service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-35880aed-3d47-40d0-903d-0dd054e56930 req-4a0cb0d8-08c1-4c5d-9cdd-a39aa375de9e service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-35880aed-3d47-40d0-903d-0dd054e56930 req-4a0cb0d8-08c1-4c5d-9cdd-a39aa375de9e service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] No waiting events found dispatching network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:31:17 user nova-compute[75215]: WARNING nova.compute.manager [req-35880aed-3d47-40d0-903d-0dd054e56930 req-4a0cb0d8-08c1-4c5d-9cdd-a39aa375de9e service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received unexpected event network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e for instance with vm_state building and task_state spawning.
Nov 11 01:31:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updating instance_info_cache with network_info: [{"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:31:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 01:31:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 01:31:18 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:31:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzxv0h6xl/6d3192ffc5ae4122ad29eeaa6972f18c.delta /opt/stack/data/nova/instances/snapshots/tmpzxv0h6xl/6d3192ffc5ae4122ad29eeaa6972f18c {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzxv0h6xl/6d3192ffc5ae4122ad29eeaa6972f18c.delta /opt/stack/data/nova/instances/snapshots/tmpzxv0h6xl/6d3192ffc5ae4122ad29eeaa6972f18c" returned: 0 in 0.546s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Snapshot extracted, beginning image upload
Nov 11 01:31:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-e2363343-a4b8-454b-bc26-2b75fb3fb06b req-4f03a92f-7fda-4d78-b262-4d4fced691d0 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-changed-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-e2363343-a4b8-454b-bc26-2b75fb3fb06b req-4f03a92f-7fda-4d78-b262-4d4fced691d0 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Refreshing instance network info cache due to event network-changed-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e2363343-a4b8-454b-bc26-2b75fb3fb06b req-4f03a92f-7fda-4d78-b262-4d4fced691d0 service nova] Acquiring lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e2363343-a4b8-454b-bc26-2b75fb3fb06b req-4f03a92f-7fda-4d78-b262-4d4fced691d0 service nova] Acquired lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-e2363343-a4b8-454b-bc26-2b75fb3fb06b req-4f03a92f-7fda-4d78-b262-4d4fced691d0 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Refreshing network info cache for port 9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-aa7bf7d2-3477-461f-a76b-d397ebe30ab6 req-b02ab2bd-7f0e-4c63-b35a-296ab9211fc7 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received event network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aa7bf7d2-3477-461f-a76b-d397ebe30ab6 req-b02ab2bd-7f0e-4c63-b35a-296ab9211fc7 service nova] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aa7bf7d2-3477-461f-a76b-d397ebe30ab6 req-b02ab2bd-7f0e-4c63-b35a-296ab9211fc7 service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aa7bf7d2-3477-461f-a76b-d397ebe30ab6 req-b02ab2bd-7f0e-4c63-b35a-296ab9211fc7 service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-aa7bf7d2-3477-461f-a76b-d397ebe30ab6 req-b02ab2bd-7f0e-4c63-b35a-296ab9211fc7 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] No waiting events found dispatching network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:31:19 user nova-compute[75215]: WARNING nova.compute.manager [req-aa7bf7d2-3477-461f-a76b-d397ebe30ab6 req-b02ab2bd-7f0e-4c63-b35a-296ab9211fc7 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received unexpected event network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e for instance with vm_state building and task_state spawning.
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-e2363343-a4b8-454b-bc26-2b75fb3fb06b req-4f03a92f-7fda-4d78-b262-4d4fced691d0 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updated VIF entry in instance network info cache for port 9fd51c5f-2f3b-4df5-92c8-3d84fe37691b. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-e2363343-a4b8-454b-bc26-2b75fb3fb06b req-4f03a92f-7fda-4d78-b262-4d4fced691d0 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e2363343-a4b8-454b-bc26-2b75fb3fb06b req-4f03a92f-7fda-4d78-b262-4d4fced691d0 service nova] Releasing lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:31:19 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Instance spawned successfully.
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:31:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:31:20 user nova-compute[75215]: INFO nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 11 01:31:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:31:20 user nova-compute[75215]: INFO nova.compute.manager [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Took 33.28 seconds to build instance.
Nov 11 01:31:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9e8712fa-88e3-4dfa-963b-e65119b5f21d tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.368s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ef22f3e-bad6-4d3f-9675-730cf629985d req-8ecca96e-740e-46fe-a013-edb9c88072f1 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-changed-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ef22f3e-bad6-4d3f-9675-730cf629985d req-8ecca96e-740e-46fe-a013-edb9c88072f1 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Refreshing instance network info cache due to event network-changed-544706ff-9665-4194-8957-4435ae082aac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ef22f3e-bad6-4d3f-9675-730cf629985d req-8ecca96e-740e-46fe-a013-edb9c88072f1 service nova] Acquiring lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ef22f3e-bad6-4d3f-9675-730cf629985d req-8ecca96e-740e-46fe-a013-edb9c88072f1 service nova] Acquired lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-3ef22f3e-bad6-4d3f-9675-730cf629985d req-8ecca96e-740e-46fe-a013-edb9c88072f1 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Refreshing network info cache for port 544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG nova.objects.instance [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lazy-loading 'flavor' on Instance uuid fb579a71-869d-41ce-9572-4f87a11378fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:21 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Snapshot image upload complete
Nov 11 01:31:21 user nova-compute[75215]: INFO nova.compute.manager [None req-8800b8a2-4475-4b6c-b7bd-82ec190dd7e9 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Took 6.26 seconds to snapshot the instance on the hypervisor.
Nov 11 01:31:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-3ef22f3e-bad6-4d3f-9675-730cf629985d req-8ecca96e-740e-46fe-a013-edb9c88072f1 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updated VIF entry in instance network info cache for port 544706ff-9665-4194-8957-4435ae082aac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-3ef22f3e-bad6-4d3f-9675-730cf629985d req-8ecca96e-740e-46fe-a013-edb9c88072f1 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ef22f3e-bad6-4d3f-9675-730cf629985d req-8ecca96e-740e-46fe-a013-edb9c88072f1 service nova] Releasing lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.135s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:21 user nova-compute[75215]: INFO nova.compute.manager [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Attaching volume e03e304d-4f45-46a8-b946-bd42340a1024 to /dev/vdb
Nov 11 01:31:21 user nova-compute[75215]: DEBUG os_brick.utils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:31:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[349937d8-ee33-4c67-a13e-a98f740b97da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1260e8-abbc-4916-96d1-3238674097a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83942e5b-60f0-4c48-8326-946e3dacb7a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c63bab6-fdbf-4316-8dfd-f554c966221a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:22 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:31:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb84ced9-888f-4376-be1d-cafc1cb6be84]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG os_brick.utils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:31:22 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Updating existing volume attachment record: 185ee5e8-82a2-47ea-9642-ecbe69d74b5e {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:31:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:31:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:24 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:31:24 user nova-compute[75215]: INFO nova.compute.claims [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Claim successful on node user
Nov 11 01:31:25 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:31:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:31:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:31:25 user nova-compute[75215]: INFO nova.virt.block_device [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Booting with volume 1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d at /dev/vda
Nov 11 01:31:25 user nova-compute[75215]: DEBUG nova.policy [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4aa36891e1164546994ea1a2308fab65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d06db6e47a408d958c8ac0028856ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG os_brick.utils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b561d5-ef41-4f99-bd98-1ffacfcac98d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd4125-8b9e-4607-9413-c7b72dc8514f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d182124-19e6-4da7-828d-baed7ba9d420]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3dbb6a-dd43-4aa4-aea7-fd444f8de9fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:25 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:31:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c276d5-3cf3-48e1-ae96-61e397f01d81]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG os_brick.utils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:31:25 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating existing volume attachment record: c0b502c0-67b6-4d9e-8aef-b79013fdb5ee {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully created port: 7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:26 user nova-compute[75215]: INFO nova.compute.manager [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Attaching volume 36d2eade-7266-431a-841c-7bd5c33569e5 to /dev/vdb
Nov 11 01:31:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully created port: 142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG os_brick.utils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a1fee6-d7fb-4cb5-86c8-def37be867a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a2da70-7ae4-4935-8151-c59497a7b2a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79b29a0-2b3f-4276-aea7-2a9112ee78da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[948974cb-5e3e-413f-8748-47f6603496bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:26 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:31:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3465c863-dc8b-46bf-89f4-91f849ce4889]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG os_brick.utils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:31:26 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating existing volume attachment record: 715b1ebd-3ee0-40e3-b53b-0842bfe8ad88 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:31:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully created port: ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:31:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully created port: 4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:31:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully created port: 4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:31:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully updated port: 7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-55baf548-de18-4dec-8e6d-1a0ade65ddef req-0ee03798-7839-4a45-8e94-ab205de45668 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-changed-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-55baf548-de18-4dec-8e6d-1a0ade65ddef req-0ee03798-7839-4a45-8e94-ab205de45668 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing instance network info cache due to event network-changed-7398a138-4e55-4f66-bbb4-15b5984ca9b1. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55baf548-de18-4dec-8e6d-1a0ade65ddef req-0ee03798-7839-4a45-8e94-ab205de45668 service nova] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55baf548-de18-4dec-8e6d-1a0ade65ddef req-0ee03798-7839-4a45-8e94-ab205de45668 service nova] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-55baf548-de18-4dec-8e6d-1a0ade65ddef req-0ee03798-7839-4a45-8e94-ab205de45668 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing network info cache for port 7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-55baf548-de18-4dec-8e6d-1a0ade65ddef req-0ee03798-7839-4a45-8e94-ab205de45668 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-55baf548-de18-4dec-8e6d-1a0ade65ddef req-0ee03798-7839-4a45-8e94-ab205de45668 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55baf548-de18-4dec-8e6d-1a0ade65ddef req-0ee03798-7839-4a45-8e94-ab205de45668 service nova] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully updated port: b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:31:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully updated port: 12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-changed-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing instance network info cache due to event network-changed-b026352a-77fc-4695-a7f2-1b5ee72c9bcc. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing network info cache for port b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-changed-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing instance network info cache due to event network-changed-12ef6d6e-de92-484c-b739-c6b996a087fa. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing network info cache for port 12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully updated port: 142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b89d05f1-da1e-4461-8df7-affa3d1131b0 req-97b46c3c-e895-419b-86cb-23698ea05975 service nova] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully updated port: ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:31:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully updated port: 4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-changed-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing instance network info cache due to event network-changed-142fc2a0-8b74-459d-a5ae-caa1ecfd5745. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing network info cache for port 142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-changed-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing instance network info cache due to event network-changed-ebbeba2a-d881-4978-afae-3b5942328ed0. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing network info cache for port ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Successfully updated port: 4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-changed-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing instance network info cache due to event network-changed-4218d5db-bda9-4828-83b3-bb481228ad92. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing network info cache for port 4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:31:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00054c45-f030-4f8a-8534-7cbf6193df46 req-aee73da5-1c27-4b4a-9600-3ac42ec54c30 service nova] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:31:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:31:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-057633e4-02e2-46b4-a571-395bb3b84144 req-66a7dc1a-7181-4e44-b26b-bb060c42d915 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-changed-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-057633e4-02e2-46b4-a571-395bb3b84144 req-66a7dc1a-7181-4e44-b26b-bb060c42d915 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing instance network info cache due to event network-changed-4ca5faf6-ab9d-4681-8990-c6a44198dda5. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-057633e4-02e2-46b4-a571-395bb3b84144 req-66a7dc1a-7181-4e44-b26b-bb060c42d915 service nova] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [{"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance network_info: |[{"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-057633e4-02e2-46b4-a571-395bb3b84144 req-66a7dc1a-7181-4e44-b26b-bb060c42d915 service nova] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-057633e4-02e2-46b4-a571-395bb3b84144 req-66a7dc1a-7181-4e44-b26b-bb060c42d915 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing network info cache for port 4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-057633e4-02e2-46b4-a571-395bb3b84144 req-66a7dc1a-7181-4e44-b26b-bb060c42d915 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updated VIF entry in instance network info cache for port 4ca5faf6-ab9d-4681-8990-c6a44198dda5. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-057633e4-02e2-46b4-a571-395bb3b84144 req-66a7dc1a-7181-4e44-b26b-bb060c42d915 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [{"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-057633e4-02e2-46b4-a571-395bb3b84144 req-66a7dc1a-7181-4e44-b26b-bb060c42d915 service nova] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ad06ca9-a89e-499a-a245-a74ac77ec204 req-e2ba6ed7-975f-40cd-b45a-d98085851ac6 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received event network-changed-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ad06ca9-a89e-499a-a245-a74ac77ec204 req-e2ba6ed7-975f-40cd-b45a-d98085851ac6 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Refreshing instance network info cache due to event network-changed-7b29616a-00a0-4643-b438-b923d6713538. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad06ca9-a89e-499a-a245-a74ac77ec204 req-e2ba6ed7-975f-40cd-b45a-d98085851ac6 service nova] Acquiring lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad06ca9-a89e-499a-a245-a74ac77ec204 req-e2ba6ed7-975f-40cd-b45a-d98085851ac6 service nova] Acquired lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-3ad06ca9-a89e-499a-a245-a74ac77ec204 req-e2ba6ed7-975f-40cd-b45a-d98085851ac6 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Refreshing network info cache for port 7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-3ad06ca9-a89e-499a-a245-a74ac77ec204 req-e2ba6ed7-975f-40cd-b45a-d98085851ac6 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updated VIF entry in instance network info cache for port 7b29616a-00a0-4643-b438-b923d6713538. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-3ad06ca9-a89e-499a-a245-a74ac77ec204 req-e2ba6ed7-975f-40cd-b45a-d98085851ac6 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updating instance_info_cache with network_info: [{"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ad06ca9-a89e-499a-a245-a74ac77ec204 req-e2ba6ed7-975f-40cd-b45a-d98085851ac6 service nova] Releasing lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-e9afcca7-9fe6-433e-82dd-3093175a7474 req-591e22f8-b8ab-45f8-80ce-e5b94e843d43 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received event network-changed-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-e9afcca7-9fe6-433e-82dd-3093175a7474 req-591e22f8-b8ab-45f8-80ce-e5b94e843d43 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Refreshing instance network info cache due to event network-changed-bdc930c6-56b8-46bb-8645-496286713b8c. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e9afcca7-9fe6-433e-82dd-3093175a7474 req-591e22f8-b8ab-45f8-80ce-e5b94e843d43 service nova] Acquiring lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e9afcca7-9fe6-433e-82dd-3093175a7474 req-591e22f8-b8ab-45f8-80ce-e5b94e843d43 service nova] Acquired lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-e9afcca7-9fe6-433e-82dd-3093175a7474 req-591e22f8-b8ab-45f8-80ce-e5b94e843d43 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Refreshing network info cache for port bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-e9afcca7-9fe6-433e-82dd-3093175a7474 req-591e22f8-b8ab-45f8-80ce-e5b94e843d43 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Updated VIF entry in instance network info cache for port bdc930c6-56b8-46bb-8645-496286713b8c. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-e9afcca7-9fe6-433e-82dd-3093175a7474 req-591e22f8-b8ab-45f8-80ce-e5b94e843d43 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Updating instance_info_cache with network_info: [{"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e9afcca7-9fe6-433e-82dd-3093175a7474 req-591e22f8-b8ab-45f8-80ce-e5b94e843d43 service nova] Releasing lock "refresh_cache-1a7404dd-181a-40d5-af0a-e6b2dd8e1958" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQftxXdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:31:47 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:31:47 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:31:47 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39acfba-befa-4a58-beb2-be7673cfd645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:31:47 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad84515-eba1-4589-91c2-292e45c7df31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024] added
Nov 11 01:31:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bf9bb5-b458-4886-95a5-b0b8f1b32b18]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bfceec-a7a9-46df-bd67-e123bdef048d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HQftxXdp {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HQftxXdp" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[905631fb-31a1-4420-9c1b-b54b2a7f374e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HQftxXdp'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff41d8f9-432b-4e5f-820b-c4326ad38ed4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c567391f-b3e9-4d68-9f79-4b73cac9be3e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:31:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:31:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f40536-8c96-400a-b332-1982c8debdf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024, portal: 172.16.0.220,3260]
Nov 11 01:31:47 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024, portal: 172.16.0.220,3260] successful.
Nov 11 01:31:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ff9991-35e8-4d43-ae69-1470a6368725]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0177ccf0-1d32-4e5f-872c-c0f57dc501cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:31:47 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 (non-flash)
Nov 11 01:31:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:31:47 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 (non-flash)
Nov 11 01:31:47 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d708581-609b-449a-8a8b-c3804238c442]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:31:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQftxXdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:31:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:31:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23133323539613239', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:31:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133323539613239', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:31:48 user nova-compute[75215]: DEBUG nova.objects.instance [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lazy-loading 'flavor' on Instance uuid fb579a71-869d-41ce-9572-4f87a11378fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:31:48 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:31:48 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:31:48 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:31:48 user nova-compute[75215]:   <serial>e03e304d-4f45-46a8-b946-bd42340a1024</serial>
Nov 11 01:31:48 user nova-compute[75215]: </disk>
Nov 11 01:31:48 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:31:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:31:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:31:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] No VIF found with MAC fa:16:3e:32:d4:99, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:31:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-736a049c-2440-4b51-b2f7-017f81f30530 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.687s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:50 user nova-compute[75215]: INFO nova.compute.manager [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Terminating instance
Nov 11 01:31:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-24e945f5-0de7-4145-bd6c-2c30f190c5ae req-f4e9685d-3624-4060-98ce-410c5e605a54 service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received event network-vif-unplugged-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-24e945f5-0de7-4145-bd6c-2c30f190c5ae req-f4e9685d-3624-4060-98ce-410c5e605a54 service nova] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-24e945f5-0de7-4145-bd6c-2c30f190c5ae req-f4e9685d-3624-4060-98ce-410c5e605a54 service nova] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-24e945f5-0de7-4145-bd6c-2c30f190c5ae req-f4e9685d-3624-4060-98ce-410c5e605a54 service nova] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-24e945f5-0de7-4145-bd6c-2c30f190c5ae req-f4e9685d-3624-4060-98ce-410c5e605a54 service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] No waiting events found dispatching network-vif-unplugged-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-24e945f5-0de7-4145-bd6c-2c30f190c5ae req-f4e9685d-3624-4060-98ce-410c5e605a54 service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received event network-vif-unplugged-5539d217-03db-4412-9028-cb341052c5dc for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-18cb728b-0c40-4aa4-9121-20682b7372fa req-428a0fa8-f3b0-4775-88b6-28ef17f4ef53 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-changed-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-18cb728b-0c40-4aa4-9121-20682b7372fa req-428a0fa8-f3b0-4775-88b6-28ef17f4ef53 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Refreshing instance network info cache due to event network-changed-997c39fb-7e21-4af1-acf2-e0e70157b02d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-18cb728b-0c40-4aa4-9121-20682b7372fa req-428a0fa8-f3b0-4775-88b6-28ef17f4ef53 service nova] Acquiring lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-18cb728b-0c40-4aa4-9121-20682b7372fa req-428a0fa8-f3b0-4775-88b6-28ef17f4ef53 service nova] Acquired lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-18cb728b-0c40-4aa4-9121-20682b7372fa req-428a0fa8-f3b0-4775-88b6-28ef17f4ef53 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Refreshing network info cache for port 997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Instance destroyed successfully.
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.objects.instance [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lazy-loading 'resources' on Instance uuid fb579a71-869d-41ce-9572-4f87a11378fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2082431397',display_name='tempest-DeleteServersTestJSON-server-2082431397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2082431397',id=3,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59fd9bc069854266adfdea2c19670a37',ramdisk_id='',reservation_id='r-xj6lmple',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-796840098',owner_user_name='tempest-DeleteServersTestJSON-796840098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:29:40Z,user_data=None,user_id='b46b01a4376441879b862458245e7776',uuid=fb579a71-869d-41ce-9572-4f87a11378fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Converting VIF {"id": "5539d217-03db-4412-9028-cb341052c5dc", "address": "fa:16:3e:32:d4:99", "network": {"id": "6c9d6ef4-3d07-4cb5-9ae3-bff34d730960", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-265344826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59fd9bc069854266adfdea2c19670a37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5539d217-03", "ovs_interfaceid": "5539d217-03db-4412-9028-cb341052c5dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:99,bridge_name='br-int',has_traffic_filtering=True,id=5539d217-03db-4412-9028-cb341052c5dc,network=Network(6c9d6ef4-3d07-4cb5-9ae3-bff34d730960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5539d217-03') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_vif [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:99,bridge_name='br-int',has_traffic_filtering=True,id=5539d217-03db-4412-9028-cb341052c5dc,network=Network(6c9d6ef4-3d07-4cb5-9ae3-bff34d730960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5539d217-03') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5539d217-03, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f38bef8-4c43-4929-b834-1bf01e8aa6c0) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:51 user nova-compute[75215]: INFO os_vif [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:99,bridge_name='br-int',has_traffic_filtering=True,id=5539d217-03db-4412-9028-cb341052c5dc,network=Network(6c9d6ef4-3d07-4cb5-9ae3-bff34d730960),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5539d217-03')
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQftxXdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:31:51 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a77360-f159-452d-ac15-d666cc0a3f61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:31:51 user nova-compute[75215]: No targets found.
Nov 11 01:31:51 user nova-compute[75215]: iSNS:
Nov 11 01:31:51 user nova-compute[75215]: No targets found.
Nov 11 01:31:51 user nova-compute[75215]: STATIC:
Nov 11 01:31:51 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c
Nov 11 01:31:51 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:31:51 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:31:51 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024
Nov 11 01:31:51 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:31:51 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:31:51 user nova-compute[75215]: FIRMWARE:
Nov 11 01:31:51 user nova-compute[75215]: No targets found.
Nov 11 01:31:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:31:51 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:31:51 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f60ca-34d2-44d4-bcbe-1e7509a1b2a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[741787bf-a786-4a39-8340-66d490c857a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:31:51 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 (non-flash)
Nov 11 01:31:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:31:51 user nova-compute[75215]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 (non-flash)
Nov 11 01:31:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40644ca5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2644d65-a300-4685-be66-8d330ad9284e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591a575-05fa-41d3-becb-bd8a5b34927f]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4aa01f-1583-4cda-bd6a-0456ec4d2e36]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "interface-c7c8d8f5-5e51-4e02-8001-ea843090f471-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "interface-c7c8d8f5-5e51-4e02-8001-ea843090f471-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.objects.instance [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lazy-loading 'flavor' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-18cb728b-0c40-4aa4-9121-20682b7372fa req-428a0fa8-f3b0-4775-88b6-28ef17f4ef53 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updated VIF entry in instance network info cache for port 997c39fb-7e21-4af1-acf2-e0e70157b02d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-18cb728b-0c40-4aa4-9121-20682b7372fa req-428a0fa8-f3b0-4775-88b6-28ef17f4ef53 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating instance_info_cache with network_info: [{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e52374e-6e0b-4bf4-a49d-17f8429b75d5]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-18cb728b-0c40-4aa4-9121-20682b7372fa req-428a0fa8-f3b0-4775-88b6-28ef17f4ef53 service nova] Releasing lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a5eb48-15c7-411f-9a6a-11799a568854]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1dbb1a-0d3e-4ce5-b73e-235914ed874a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024, portal: 172.16.0.220,3260]
Nov 11 01:31:51 user nova-compute[75215]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024, portal: 172.16.0.220,3260] successful.
Nov 11 01:31:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e03e304d-4f45-46a8-b946-bd42340a1024 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0066fe-dd62-4637-a7c2-87bf75f31d75]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] <== disconnect_volume: return (297ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:31:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Deleting instance files /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd_del
Nov 11 01:31:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Deletion of /opt/stack/data/nova/instances/fb579a71-869d-41ce-9572-4f87a11378fd_del complete
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.objects.instance [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lazy-loading 'pci_requests' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.objects.base [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Object Instance<c7c8d8f5-5e51-4e02-8001-ea843090f471> lazy-loaded attributes: flavor,pci_requests {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:31:51 user nova-compute[75215]: INFO nova.compute.manager [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 11 01:31:51 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:31:51 user nova-compute[75215]: DEBUG nova.policy [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6269f798c52c45ee9ca9aa29a4487798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e369e597968643269939d15256b6ae97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:31:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-1703c9a3-35a2-482b-8693-8b2ac77cc3c9 req-2077cdd9-f75c-42f9-b59d-85993c07894b service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received event network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1703c9a3-35a2-482b-8693-8b2ac77cc3c9 req-2077cdd9-f75c-42f9-b59d-85993c07894b service nova] Acquiring lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1703c9a3-35a2-482b-8693-8b2ac77cc3c9 req-2077cdd9-f75c-42f9-b59d-85993c07894b service nova] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1703c9a3-35a2-482b-8693-8b2ac77cc3c9 req-2077cdd9-f75c-42f9-b59d-85993c07894b service nova] Lock "fb579a71-869d-41ce-9572-4f87a11378fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-1703c9a3-35a2-482b-8693-8b2ac77cc3c9 req-2077cdd9-f75c-42f9-b59d-85993c07894b service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] No waiting events found dispatching network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:31:52 user nova-compute[75215]: WARNING nova.compute.manager [req-1703c9a3-35a2-482b-8693-8b2ac77cc3c9 req-2077cdd9-f75c-42f9-b59d-85993c07894b service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received unexpected event network-vif-plugged-5539d217-03db-4412-9028-cb341052c5dc for instance with vm_state active and task_state deleting.
Nov 11 01:31:52 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:52 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Took 1.51 seconds to deallocate network for instance.
Nov 11 01:31:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-81e7d593-c655-4bce-bed5-627c582e4d43 req-645c26f7-3840-4de0-b7df-310b928d5ba7 service nova] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Received event network-vif-deleted-5539d217-03db-4412-9028-cb341052c5dc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Successfully created port: 76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:31:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Successfully updated port: 76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquired lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:31:54 user nova-compute[75215]: INFO nova.compute.manager [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] [instance: fb579a71-869d-41ce-9572-4f87a11378fd] Took 1.15 seconds to detach 1 volumes for instance.
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lazy-loading 'flavor' on Instance uuid a0456c90-8b61-44aa-9484-08d9a481f8a7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lazy-loading 'flavor' on Instance uuid ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:54 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Deleted allocations for instance fb579a71-869d-41ce-9572-4f87a11378fd
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:54 user nova-compute[75215]: INFO nova.compute.manager [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Attaching volume f64dd3fc-d120-4c18-b13d-249f7da0f133 to /dev/vdb
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating instance_info_cache with network_info: [{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Releasing lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:54 user nova-compute[75215]: INFO nova.compute.manager [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Attaching volume b38e610e-48de-43e0-8826-95fa276a5725 to /dev/vdb
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-383cab0f-22ea-47b2-a899-f6b1cfeb2c15 tempest-DeleteServersTestJSON-796840098 tempest-DeleteServersTestJSON-796840098-project-member] Lock "fb579a71-869d-41ce-9572-4f87a11378fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.569s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converting VIF {"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG os_vif [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebc605d6-6426-5f18-8482-2c45d5ff591b', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76a7c0e1-39, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76a7c0e1-39, col_values=(('qos', UUID('cc451e7a-4ac4-419b-8b7c-d85e9e198624')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76a7c0e1-39, col_values=(('external_ids', {'iface-id': '76a7c0e1-3978-4f0a-825a-bf6bd5f36095', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:5a:32', 'vm-uuid': 'c7c8d8f5-5e51-4e02-8001-ea843090f471'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: INFO os_vif [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39')
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converting VIF {"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] attach device xml: <interface type="ethernet">
Nov 11 01:31:54 user nova-compute[75215]:   <mac address="fa:16:3e:45:5a:32"/>
Nov 11 01:31:54 user nova-compute[75215]:   <model type="virtio"/>
Nov 11 01:31:54 user nova-compute[75215]:   <mtu size="1442"/>
Nov 11 01:31:54 user nova-compute[75215]:   <target dev="tap76a7c0e1-39"/>
Nov 11 01:31:54 user nova-compute[75215]: </interface>
Nov 11 01:31:54 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lazy-loading 'flavor' on Instance uuid 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG os_brick.utils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[23de88e6-1cf9-4598-9f93-d3adc4cc0cb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[300a6110-a05e-46a3-a4b8-d5d14bb26588]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG os_brick.utils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a33c97-2d75-4062-b3ff-f06440c6ce51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c321bb-86d6-4851-820a-d7aefd33ff40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[adee4d03-6efa-4f83-a4bc-d14806f0adf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:55 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[943abf3c-b984-4f4a-a6a3-a9284dcc3a06]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.utils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Updating existing volume attachment record: f601e647-a83e-48cb-896b-564f6ae4d141 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.035s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8576c2-7f10-4e8c-b512-0d6073964895]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received event network-changed-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Refreshing instance network info cache due to event network-changed-9f846e49-33b9-4b5c-a170-258eeae8471f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] Acquiring lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] Acquired lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Refreshing network info cache for port 9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e8bc5-baca-44db-80c0-5fe7260e641d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f248b217-8ce3-40eb-b129-640523f20e45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:55 user nova-compute[75215]: INFO nova.compute.manager [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Attaching volume 5c46c730-c209-4cc7-8954-d909ab621a7f to /dev/sdc
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:31:55 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba51f2d-8a89-4a3c-8cfb-37e43c8c7303]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG os_brick.utils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] <== get_connector_properties: return (222ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updating existing volume attachment record: bcc6d62d-547e-440f-b7c4-330bea7f88bc {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-d30c8611-2f81-4b57-b2ed-7481a4b647a7 req-8842f4fb-2298-4d97-8c79-2014556a9f0b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d30c8611-2f81-4b57-b2ed-7481a4b647a7 req-8842f4fb-2298-4d97-8c79-2014556a9f0b service nova] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d30c8611-2f81-4b57-b2ed-7481a4b647a7 req-8842f4fb-2298-4d97-8c79-2014556a9f0b service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d30c8611-2f81-4b57-b2ed-7481a4b647a7 req-8842f4fb-2298-4d97-8c79-2014556a9f0b service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-d30c8611-2f81-4b57-b2ed-7481a4b647a7 req-8842f4fb-2298-4d97-8c79-2014556a9f0b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] No waiting events found dispatching network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:31:55 user nova-compute[75215]: WARNING nova.compute.manager [req-d30c8611-2f81-4b57-b2ed-7481a4b647a7 req-8842f4fb-2298-4d97-8c79-2014556a9f0b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received unexpected event network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 for instance with vm_state active and task_state None.
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No VIF found with MAC fa:16:3e:95:05:3a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:31:55 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 11 01:31:55 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-1881855644</nova:name>
Nov 11 01:31:55 user nova-compute[75215]:   <nova:creationTime>2023-11-11 01:31:55</nova:creationTime>
Nov 11 01:31:55 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 11 01:31:55 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 11 01:31:55 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 11 01:31:55 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 11 01:31:55 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:31:55 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 11 01:31:55 user nova-compute[75215]:   </nova:flavor>
Nov 11 01:31:55 user nova-compute[75215]:   <nova:owner>
Nov 11 01:31:55 user nova-compute[75215]:     <nova:user uuid="6269f798c52c45ee9ca9aa29a4487798">tempest-TaggedAttachmentsTest-1511763889-project-member</nova:user>
Nov 11 01:31:55 user nova-compute[75215]:     <nova:project uuid="e369e597968643269939d15256b6ae97">tempest-TaggedAttachmentsTest-1511763889</nova:project>
Nov 11 01:31:55 user nova-compute[75215]:   </nova:owner>
Nov 11 01:31:55 user nova-compute[75215]:   <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:31:55 user nova-compute[75215]:   <nova:ports>
Nov 11 01:31:55 user nova-compute[75215]:     <nova:port uuid="997c39fb-7e21-4af1-acf2-e0e70157b02d">
Nov 11 01:31:55 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:31:55 user nova-compute[75215]:     </nova:port>
Nov 11 01:31:55 user nova-compute[75215]:     <nova:port uuid="76a7c0e1-3978-4f0a-825a-bf6bd5f36095">
Nov 11 01:31:55 user nova-compute[75215]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Nov 11 01:31:55 user nova-compute[75215]:     </nova:port>
Nov 11 01:31:55 user nova-compute[75215]:   </nova:ports>
Nov 11 01:31:55 user nova-compute[75215]: </nova:instance>
Nov 11 01:31:55 user nova-compute[75215]:  {{(pid=75215) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80071345-a12b-42d6-a08f-50c4082fae5e tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "interface-c7c8d8f5-5e51-4e02-8001-ea843090f471-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.145s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Updated VIF entry in instance network info cache for port 9f846e49-33b9-4b5c-a170-258eeae8471f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Updating instance_info_cache with network_info: [{"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] Releasing lock "refresh_cache-a0456c90-8b61-44aa-9484-08d9a481f8a7" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-changed-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Refreshing instance network info cache due to event network-changed-76a7c0e1-3978-4f0a-825a-bf6bd5f36095. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] Acquiring lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] Acquired lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Refreshing network info cache for port 76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updated VIF entry in instance network info cache for port 76a7c0e1-3978-4f0a-825a-bf6bd5f36095. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating instance_info_cache with network_info: [{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e96fb6c6-4b08-4ed5-a59d-3d2ee5af1272 req-b932c1c0-0354-4e2c-842d-f67df112a2e3 service nova] Releasing lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d3b6040-3438-41e0-987d-4d2109830e01 req-af0292bd-bfea-40ef-bd09-8b0855dc641f service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d3b6040-3438-41e0-987d-4d2109830e01 req-af0292bd-bfea-40ef-bd09-8b0855dc641f service nova] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:31:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d3b6040-3438-41e0-987d-4d2109830e01 req-af0292bd-bfea-40ef-bd09-8b0855dc641f service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:31:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d3b6040-3438-41e0-987d-4d2109830e01 req-af0292bd-bfea-40ef-bd09-8b0855dc641f service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:31:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d3b6040-3438-41e0-987d-4d2109830e01 req-af0292bd-bfea-40ef-bd09-8b0855dc641f service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] No waiting events found dispatching network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:31:57 user nova-compute[75215]: WARNING nova.compute.manager [req-3d3b6040-3438-41e0-987d-4d2109830e01 req-af0292bd-bfea-40ef-bd09-8b0855dc641f service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received unexpected event network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 for instance with vm_state active and task_state None.
Nov 11 01:31:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-322b9f85-ec69-4c52-bfb6-3ea836c82137 req-b7fa6357-7e3e-442d-bfd3-0ddf6ffa6e5f service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received event network-changed-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-322b9f85-ec69-4c52-bfb6-3ea836c82137 req-b7fa6357-7e3e-442d-bfd3-0ddf6ffa6e5f service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Refreshing instance network info cache due to event network-changed-21229308-4609-4594-9c02-2d5a73c7ce1d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-322b9f85-ec69-4c52-bfb6-3ea836c82137 req-b7fa6357-7e3e-442d-bfd3-0ddf6ffa6e5f service nova] Acquiring lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-322b9f85-ec69-4c52-bfb6-3ea836c82137 req-b7fa6357-7e3e-442d-bfd3-0ddf6ffa6e5f service nova] Acquired lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-322b9f85-ec69-4c52-bfb6-3ea836c82137 req-b7fa6357-7e3e-442d-bfd3-0ddf6ffa6e5f service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Refreshing network info cache for port 21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-322b9f85-ec69-4c52-bfb6-3ea836c82137 req-b7fa6357-7e3e-442d-bfd3-0ddf6ffa6e5f service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updated VIF entry in instance network info cache for port 21229308-4609-4594-9c02-2d5a73c7ce1d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-322b9f85-ec69-4c52-bfb6-3ea836c82137 req-b7fa6357-7e3e-442d-bfd3-0ddf6ffa6e5f service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updating instance_info_cache with network_info: [{"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-322b9f85-ec69-4c52-bfb6-3ea836c82137 req-b7fa6357-7e3e-442d-bfd3-0ddf6ffa6e5f service nova] Releasing lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:31:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:32:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:32:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:32:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:32:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:32:14 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:32:14 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7228MB free_disk=25.547733306884766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c7c8d8f5-5e51-4e02-8001-ea843090f471 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a0456c90-8b61-44aa-9484-08d9a481f8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b7244d96-4c01-4a87-b76c-d76ba83e3879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:32:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veykfYdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:32:16 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:32:16 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:32:16 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8908b2-eb25-4663-8285-f118ce5efb0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:32:16 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d3f8bc-2ee9-4d8b-8c2a-83a468c01513]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5] added
Nov 11 01:32:16 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6219593a-5c74-46ab-a7b0-2f1a4bdf448a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70281f9-79e8-452a-ac6f-45319aefcc5b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veykfYdt {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veykfYdt" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[193642c4-ee4f-49e1-a48b-35bb1bbbcddd]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'veykfYdt'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:32:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ada6e2-3b21-4b07-b06e-9317b52bd341]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lazy-loading 'flavor' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4464f9-5a47-41da-8d1c-9dc05c7c4999]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:32:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:32:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[84682cdd-cc9b-49b6-a065-926e5575edd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260]
Nov 11 01:32:17 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260] successful.
Nov 11 01:32:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lazy-loading 'flavor' on Instance uuid b58b0c19-8c8a-482b-a693-eb6855ed5dd1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc8daba-9bcd-45dd-92d4-550f010bd1e7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: INFO nova.virt.block_device [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Booting with volume 215d826c-552a-4d8e-a079-2cab7f94d56f at /dev/vdb
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.utils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e093ad0-2790-4e3d-8f3a-4382bb219472]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:32:17 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:32:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:32:17 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:32:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c62fce-277f-4c82-b391-272b02b0abc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e744e1-4703-40c4-97b0-5f0e77d8174f]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veykfYdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0dca3f-5402-4dfc-a118-969f8d048f64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae836c6a-c411-4c86-ba37-8b6ad3924b55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[272d9745-3ec4-407c-8bfd-fd73e64ab6cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.utils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:32:17 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c095ad-6107-42ae-8d5b-7e5ca6136d08]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.utils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Updating existing volume attachment record: 67c9024e-cc5e-49ca-9e04-3383a4e2dda6 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:32:17 user nova-compute[75215]: INFO nova.compute.manager [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Attaching volume 40cd998c-e8a1-4685-8220-a380137b52b0 to /dev/vdb
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e3ef3-76f4-4896-9594-3a234d35a43d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[770079de-26bb-4029-8171-e427a2e29669]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86894d94-50c1-4893-81ca-29b090be9d7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a107e01-dc5f-4ba8-99a5-7776b7b2b967]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:32:17 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0cc787-3d32-429c-b304-44032138f2a2]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG os_brick.utils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating existing volume attachment record: fb2f645b-d5db-4cac-9217-092ec3b7bb7e {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:32:17 user nova-compute[75215]: INFO nova.compute.manager [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Attaching volume b101360e-a77f-4282-9c80-250fadec0c83 to /dev/vdb
Nov 11 01:32:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:32:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26463383830633731', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463383830633731', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:32:18 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:32:18 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:32:18 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:32:18 user nova-compute[75215]:   <serial>36d2eade-7266-431a-841c-7bd5c33569e5</serial>
Nov 11 01:32:18 user nova-compute[75215]: </disk>
Nov 11 01:32:18 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No VIF found with MAC fa:16:3e:7e:c3:e5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:32:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PArUaylq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:32:19 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:32:19 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:32:19 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b9cc3-2f77-4f1f-9037-bf974f18cada]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:32:19 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[01218ec6-8ecd-4640-ae5b-eae9adb3bdeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133] added
Nov 11 01:32:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[762a0502-90d8-4c14-bdd7-c4455db3a76a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1d3260-29a3-4d58-a699-eec179ec33a5]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PArUaylq {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PArUaylq" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb37fc-ec94-43bb-a8b7-5842504ce013]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PArUaylq'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d06dae-af73-41e1-b300-268be8e821d6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c68ce11-0a3f-45d4-a688-3f8d76055756]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:32:19 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:32:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:32:19 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:32:19 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:32:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0585ad89-12c5-4ea5-85ba-9da30f73313d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133, portal: 172.16.0.220,3260]
Nov 11 01:32:20 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133, portal: 172.16.0.220,3260] successful.
Nov 11 01:32:20 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[665720f3-1e22-41a0-a31a-fe54ea2af163]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1465eaf0-615c-455c-b544-3d30ed865905]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:32:20 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:32:20 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:32:20 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:32:20 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:32:20 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:32:20 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[545fb4ae-8da8-42d4-9aa4-6abbefdebe0a]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:32:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PArUaylq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:32:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:32:21 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23432396335313432', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:32:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432396335313432', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:32:21 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lazy-loading 'flavor' on Instance uuid a0456c90-8b61-44aa-9484-08d9a481f8a7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:32:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] attach device xml: <disk type="block" device="disk">
Nov 11 01:32:21 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:32:21 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:32:21 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:32:21 user nova-compute[75215]:   <serial>f64dd3fc-d120-4c18-b13d-249f7da0f133</serial>
Nov 11 01:32:21 user nova-compute[75215]: </disk>
Nov 11 01:32:21 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:32:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:32:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:32:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] No VIF found with MAC fa:16:3e:00:a6:85, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:32:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:32:24 user nova-compute[75215]: INFO nova.compute.claims [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Claim successful on node user
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:32:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:32:24 user nova-compute[75215]: DEBUG nova.policy [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '561ad55121d44be1ab7971a495b9347f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32564a70b861419eaefcb97cd327088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:32:24 user nova-compute[75215]: INFO nova.virt.block_device [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Booting with blank volume at /dev/vda
Nov 11 01:32:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Successfully created port: 427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Successfully updated port: 427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquired lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-2dbd33e9-4e54-41de-8458-d92709c833c5 req-e061d8b7-3762-49d6-af13-85904804eae0 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-changed-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-2dbd33e9-4e54-41de-8458-d92709c833c5 req-e061d8b7-3762-49d6-af13-85904804eae0 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Refreshing instance network info cache due to event network-changed-427d21a8-099b-4a97-8428-39ba7ed4d384. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2dbd33e9-4e54-41de-8458-d92709c833c5 req-e061d8b7-3762-49d6-af13-85904804eae0 service nova] Acquiring lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updating instance_info_cache with network_info: [{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Releasing lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance network_info: |[{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2dbd33e9-4e54-41de-8458-d92709c833c5 req-e061d8b7-3762-49d6-af13-85904804eae0 service nova] Acquired lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-2dbd33e9-4e54-41de-8458-d92709c833c5 req-e061d8b7-3762-49d6-af13-85904804eae0 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Refreshing network info cache for port 427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-2dbd33e9-4e54-41de-8458-d92709c833c5 req-e061d8b7-3762-49d6-af13-85904804eae0 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updated VIF entry in instance network info cache for port 427d21a8-099b-4a97-8428-39ba7ed4d384. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-2dbd33e9-4e54-41de-8458-d92709c833c5 req-e061d8b7-3762-49d6-af13-85904804eae0 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updating instance_info_cache with network_info: [{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:32:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2dbd33e9-4e54-41de-8458-d92709c833c5 req-e061d8b7-3762-49d6-af13-85904804eae0 service nova] Releasing lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:32:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-5d70c96d-111a-445a-8be2-29206cf108dd req-e5be4c80-9f59-4278-91ec-9099145ee81c service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received event network-changed-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:32:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-5d70c96d-111a-445a-8be2-29206cf108dd req-e5be4c80-9f59-4278-91ec-9099145ee81c service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Refreshing instance network info cache due to event network-changed-61201a0d-3ca2-4630-8fda-8296efd0325e. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:32:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d70c96d-111a-445a-8be2-29206cf108dd req-e5be4c80-9f59-4278-91ec-9099145ee81c service nova] Acquiring lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:32:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d70c96d-111a-445a-8be2-29206cf108dd req-e5be4c80-9f59-4278-91ec-9099145ee81c service nova] Acquired lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:32:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-5d70c96d-111a-445a-8be2-29206cf108dd req-e5be4c80-9f59-4278-91ec-9099145ee81c service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Refreshing network info cache for port 61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:32:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-5d70c96d-111a-445a-8be2-29206cf108dd req-e5be4c80-9f59-4278-91ec-9099145ee81c service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Updated VIF entry in instance network info cache for port 61201a0d-3ca2-4630-8fda-8296efd0325e. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:32:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-5d70c96d-111a-445a-8be2-29206cf108dd req-e5be4c80-9f59-4278-91ec-9099145ee81c service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Updating instance_info_cache with network_info: [{"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:32:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5d70c96d-111a-445a-8be2-29206cf108dd req-e5be4c80-9f59-4278-91ec-9099145ee81c service nova] Releasing lock "refresh_cache-ed9354d9-106b-4ca5-8f60-0140c85e74ca" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:32:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e716f99b-c355-4b24-b3e1-03f37dfa8016 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 78.851s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392ee3a-d526-4d9b-a93f-cd8dd1d577d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0e50a5-c850-448b-9289-4436c3fffffb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c6555e-c724-4bf6-bd83-6530fc884179]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[843e54b3-d89d-4ff0-aa84-2661367f4c94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:32:45 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[792c65cb-773c-4906-89e4-cc8f3c6612f4]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating existing volume attachment record: 79278094-1d81-4d26-8cd8-b7cb7823ab38 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:32:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d898d7a7-41f5-4a1e-8b30-0c28ee17ac0d tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.206s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG os_brick.utils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a973d9-dc92-454e-84ef-76b4a03d07d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b053e37-b452-43ac-812f-00e75fd804fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd7e1a-6542-4f37-8247-15b5592cfd56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b61d7-ae24-48a4-9447-a4c6c377520e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:32:46 user nova-compute[75215]: INFO nova.virt.block_device [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Booting with volume 44f2dc55-c51f-4c57-9875-308d3a0545df at /dev/vdc
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:32:46 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:32:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec153112-af35-4455-8f7d-314fcb5048e8]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG os_brick.utils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:32:46 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updating existing volume attachment record: a7081197-f793-4a06-94e0-e581e54a8c26 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:32:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:32:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:32:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:32:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:32:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:32:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:33:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:33:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:33:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:33:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMTYqVie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:08 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:08 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:33:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6435d007-23ac-490e-a125-da009ff82d0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:33:09 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDaKzwYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30931463-7099-4970-a707-3cd245aea386]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725] added
Nov 11 01:33:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[254e2bd0-99fa-48b5-86cf-8220f6c8e51f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3d49fb-f2f1-4bd5-b795-cc884716103a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NMTYqVie {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NMTYqVie" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd71f2e-717c-4689-874f-474d9c0f9ccd]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NMTYqVie'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1402edd-c0ce-419a-8913-f70a3ef03248]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d0515-7e0e-4caf-a131-4a16641c7c10]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad9c49-c4bd-4af8-979c-1686d3bc6f77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725, portal: 172.16.0.220,3260]
Nov 11 01:33:09 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c25ca5-e9c3-4666-b0e9-1aacab054394]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3e9f0f-ffec-4dea-871e-14fade753fe6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff493504-4970-431e-bbf3-58b0b27e3c12]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMTYqVie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.utils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d715dfe-f50b-47b0-8637-94b208bb4c83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[413d760d-b287-4725-b24f-8d802e3f5207]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[893d074a-f930-4e93-917d-9c533dedf4d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98277cf-94b9-4a46-b7ea-22c0283442be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:33:09 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:33:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3498b3d-f9f1-4b50-a1cf-105f3d03c57a]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG os_brick.utils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:09 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating existing volume attachment record: b12b4d9f-f7fb-4328-b11b-97cf025cee23 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62251318-1098-4e55-8f62-c9359d46f3c6 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] volume_snapshot_create: create_info: {'snapshot_id': 'f3644d63-3d0f-46e9-bf65-ca0ac7783f81', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75215) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62251318-1098-4e55-8f62-c9359d46f3c6 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] snap xml: <domainsnapshot>
Nov 11 01:33:10 user nova-compute[75215]:   <disks>
Nov 11 01:33:10 user nova-compute[75215]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 11 01:33:10 user nova-compute[75215]:       <source file="/dev/new_file"/>
Nov 11 01:33:10 user nova-compute[75215]:     </disk>
Nov 11 01:33:10 user nova-compute[75215]:     <disk name="vda" snapshot="no"/>
Nov 11 01:33:10 user nova-compute[75215]:   </disks>
Nov 11 01:33:10 user nova-compute[75215]: </domainsnapshot>
Nov 11 01:33:10 user nova-compute[75215]:  {{(pid=75215) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-62251318-1098-4e55-8f62-c9359d46f3c6 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] Lazy-loading 'system_metadata' on Instance uuid a0456c90-8b61-44aa-9484-08d9a481f8a7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0de82fe7-3964-4b4c-bd3f-a0d12ab3ee76 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] volume_snapshot_delete: delete_info: {'volume_id': 'f64dd3fc-d120-4c18-b13d-249f7da0f133'} {{(pid=75215) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-0de82fe7-3964-4b4c-bd3f-a0d12ab3ee76 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Traceback (most recent call last):
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     if delete_info['type'] != 'qcow2':
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] KeyError: 'type'
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] 
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d01b906-04df-4952-8986-ff2bbacdb4f2 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d01b906-04df-4952-8986-ff2bbacdb4f2 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d01b906-04df-4952-8986-ff2bbacdb4f2 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d01b906-04df-4952-8986-ff2bbacdb4f2 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75215) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4d01b906-04df-4952-8986-ff2bbacdb4f2 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-62251318-1098-4e55-8f62-c9359d46f3c6 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-62251318-1098-4e55-8f62-c9359d46f3c6 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Traceback (most recent call last):
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     rv = execute(f, *args, **kwargs)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     six.reraise(c, e, tb)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     raise value
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     rv = meth(*args, **kwargs)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] 
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-62251318-1098-4e55-8f62-c9359d46f3c6 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Traceback (most recent call last):
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     self._volume_snapshot_create(context, instance, guest,
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     rv = execute(f, *args, **kwargs)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     six.reraise(c, e, tb)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     raise value
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     rv = meth(*args, **kwargs)
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 01:33:10 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] 
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23961633133323233', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961633133323233', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.304s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:10 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lazy-loading 'flavor' on Instance uuid ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[43baa158-7c33-4c96-9ecf-60f91710e4ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:33:10 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:33:10 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:10 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:33:10 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:10 user nova-compute[75215]:   <serial>b38e610e-48de-43e0-8826-95fa276a5725</serial>
Nov 11 01:33:10 user nova-compute[75215]: </disk>
Nov 11 01:33:10 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3162c005-9a7a-418b-a4b4-9c9638599010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f] added
Nov 11 01:33:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80b74ec-2804-4391-8afd-39f9d335eab0]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[92279d16-cb96-4fbc-a38a-25b41b55420c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDaKzwYe {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDaKzwYe" returned: 0 in 0.043s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[022ee69f-d4ba-4684-aa7d-f5719221dfbc]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kDaKzwYe'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.009s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9e07e3-7f9e-41e3-a4b1-d7d283b2c03c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:10 user nova-compute[75215]: INFO nova.compute.manager [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Rebuilding instance
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddddf02-3a4e-4f2a-af44-b5d47f603319]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd579d-307e-495e-9ffe-c31620de9878]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f, portal: 172.16.0.220,3260]
Nov 11 01:33:10 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[34679e4a-2be1-47de-9cf1-e89ed65c8490]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07f5438-8ce7-4f59-89d6-7c694634a2aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:10 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f371f924-3c69-4c10-8c68-8f1f192b9747]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDaKzwYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-46f92b15-408a-448b-a3f6-cb3597101c56 req-12400f0a-7cdb-43c5-8a61-92dee40495ae service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46f92b15-408a-448b-a3f6-cb3597101c56 req-12400f0a-7cdb-43c5-8a61-92dee40495ae service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46f92b15-408a-448b-a3f6-cb3597101c56 req-12400f0a-7cdb-43c5-8a61-92dee40495ae service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46f92b15-408a-448b-a3f6-cb3597101c56 req-12400f0a-7cdb-43c5-8a61-92dee40495ae service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-46f92b15-408a-448b-a3f6-cb3597101c56 req-12400f0a-7cdb-43c5-8a61-92dee40495ae service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:33:10 user nova-compute[75215]: WARNING nova.compute.manager [req-46f92b15-408a-448b-a3f6-cb3597101c56 req-12400f0a-7cdb-43c5-8a61-92dee40495ae service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state active and task_state powering-off.
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] No VIF found with MAC fa:16:3e:80:95:2d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-7f989712-c6af-4574-8349-f609c0eb77ee req-48d66242-16df-47b6-b08b-7da43af065cc service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received event network-vif-unplugged-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7f989712-c6af-4574-8349-f609c0eb77ee req-48d66242-16df-47b6-b08b-7da43af065cc service nova] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7f989712-c6af-4574-8349-f609c0eb77ee req-48d66242-16df-47b6-b08b-7da43af065cc service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7f989712-c6af-4574-8349-f609c0eb77ee req-48d66242-16df-47b6-b08b-7da43af065cc service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-7f989712-c6af-4574-8349-f609c0eb77ee req-48d66242-16df-47b6-b08b-7da43af065cc service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] No waiting events found dispatching network-vif-unplugged-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:33:11 user nova-compute[75215]: WARNING nova.compute.manager [req-7f989712-c6af-4574-8349-f609c0eb77ee req-48d66242-16df-47b6-b08b-7da43af065cc service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received unexpected event network-vif-unplugged-61201a0d-3ca2-4630-8fda-8296efd0325e for instance with vm_state active and task_state rebuilding.
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Instance destroyed successfully.
Nov 11 01:33:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Instance destroyed successfully.
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1133547420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2101150845',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI4xbc95iRypDAXtYtVCO2XHcCPICwFh7x9vwaMc7ulWk0+0mVr9rQal/5zIvQw6Njf9/8Y5wXTBvl/liRgZNXAw1KwVINNL356/u7AJIV/xrZ/d2bCck0lMCyf6SxzlQ==',key_name='tempest-keypair-112562791',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0197414e73eb4e288859873fdfbff020',ramdisk_id='',reservation_id='r-5y9diyza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-470050517',owner_user_name='tempest-ServerActionsV293TestJSON-470050517-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb61d2710ea47d587e79463829c8a3e',uuid=ed9354d9-106b-4ca5-8f60-0140c85e74ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Converting VIF {"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_vif [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61201a0d-3c, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance destroyed successfully.
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4d01b906-04df-4952-8986-ff2bbacdb4f2 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e4e555f-60a5-4b27-8f8c-dcbbfdec47a1) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:11 user nova-compute[75215]: INFO os_vif [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c')
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uahLfXcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:11 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4d01b906-04df-4952-8986-ff2bbacdb4f2 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.479s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] <== connect_volume: return (2783ms) {'type': 'block', 'scsi_wwn': '23336306232303134', 'path': '/dev/sdf'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336306232303134', 'path': '/dev/sdf'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.139s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lazy-loading 'flavor' on Instance uuid 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220aab1-e307-4f75-976a-81f99c6fde4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:33:11 user nova-compute[75215]: No targets found.
Nov 11 01:33:11 user nova-compute[75215]: iSNS:
Nov 11 01:33:11 user nova-compute[75215]: No targets found.
Nov 11 01:33:11 user nova-compute[75215]: STATIC:
Nov 11 01:33:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f
Nov 11 01:33:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:33:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c
Nov 11 01:33:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725
Nov 11 01:33:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133
Nov 11 01:33:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:11 user nova-compute[75215]: FIRMWARE:
Nov 11 01:33:11 user nova-compute[75215]: No targets found.
Nov 11 01:33:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:33:11 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:33:11 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c408f97-7cab-4f3e-97d4-4b0ed00d30c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:33:11 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:11 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:33:11 user nova-compute[75215]:   <target dev="sdc" bus="scsi"/>
Nov 11 01:33:11 user nova-compute[75215]:   <serial>5c46c730-c209-4cc7-8954-d909ab621a7f</serial>
Nov 11 01:33:11 user nova-compute[75215]:   <address type="drive" controller="0" unit="2"/>
Nov 11 01:33:11 user nova-compute[75215]: </disk>
Nov 11 01:33:11 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc512690-0362-4bb3-a867-a5388fa43ba7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:11 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:11 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:11 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:11 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c (non-flash)
Nov 11 01:33:11 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:11 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:11 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:11 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404470c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bce3827-f7fb-48d5-bc9d-a34fd61abf7f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c74ef-8398-4a59-b84f-3f0c19d08b23]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be54629-9482-467b-a397-6653bbf10ba3]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[68053f84-0109-4d34-8325-e3791b5b4a4c]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26363643462643939', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7bd5deea', '/dev/disk/by-id/scsi-1SCST_BIO7bd5deea-ccd4bd99a95ca9e0') {{(pid=86647) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac25735-b505-4a48-992e-ed632a9ace64]: (4, None) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd3aefb-61da-42b4-91a5-530b2cb4ca96]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf7ab51-2788-402f-b78c-309cc37887c4]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c, portal: 172.16.0.220,3260]
Nov 11 01:33:12 user nova-compute[75215]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8346654-a94a-4f20-9e12-b76b3b7378be]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] <== disconnect_volume: return (500ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:33:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Deleting instance files /opt/stack/data/nova/instances/ed9354d9-106b-4ca5-8f60-0140c85e74ca_del
Nov 11 01:33:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Deletion of /opt/stack/data/nova/instances/ed9354d9-106b-4ca5-8f60-0140c85e74ca_del complete
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] No BDM found with device name sda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] No VIF found with MAC fa:16:3e:02:c7:65, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-6ea5c931-78e8-455e-82c0-127f91279218 req-40201232-3c04-4671-90ec-83a76356799f service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6ea5c931-78e8-455e-82c0-127f91279218 req-40201232-3c04-4671-90ec-83a76356799f service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6ea5c931-78e8-455e-82c0-127f91279218 req-40201232-3c04-4671-90ec-83a76356799f service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6ea5c931-78e8-455e-82c0-127f91279218 req-40201232-3c04-4671-90ec-83a76356799f service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-6ea5c931-78e8-455e-82c0-127f91279218 req-40201232-3c04-4671-90ec-83a76356799f service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:33:12 user nova-compute[75215]: WARNING nova.compute.manager [req-6ea5c931-78e8-455e-82c0-127f91279218 req-40201232-3c04-4671-90ec-83a76356799f service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state stopped and task_state None.
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-a619a7ea-c39a-47b2-82ed-2590106149c4 req-ef93408a-4b3c-49e4-85a9-c1c5a973f4be service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received event network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a619a7ea-c39a-47b2-82ed-2590106149c4 req-ef93408a-4b3c-49e4-85a9-c1c5a973f4be service nova] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a619a7ea-c39a-47b2-82ed-2590106149c4 req-ef93408a-4b3c-49e4-85a9-c1c5a973f4be service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a619a7ea-c39a-47b2-82ed-2590106149c4 req-ef93408a-4b3c-49e4-85a9-c1c5a973f4be service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-a619a7ea-c39a-47b2-82ed-2590106149c4 req-ef93408a-4b3c-49e4-85a9-c1c5a973f4be service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] No waiting events found dispatching network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:33:13 user nova-compute[75215]: WARNING nova.compute.manager [req-a619a7ea-c39a-47b2-82ed-2590106149c4 req-ef93408a-4b3c-49e4-85a9-c1c5a973f4be service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received unexpected event network-vif-plugged-61201a0d-3ca2-4630-8fda-8296efd0325e for instance with vm_state active and task_state rebuilding.
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdf (sdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCBmlGQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:13 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0fe3e7-e5fe-4346-b680-72e2154eb14c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:33:13 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dda18b8-4046-4cdd-94c4-ec930c083589]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0] added
Nov 11 01:33:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.136s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[856d94d1-2c25-4299-a52b-628efadbfbca]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[993c4076-0603-46ef-9567-d2e9f9340451]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCBmlGQt {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCBmlGQt" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e98dae-6c84-4210-a13d-f64e4f420fd6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LCBmlGQt'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cbc70d-cc09-4713-ae50-07d1eeae2cf0]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe0662-8f72-4cf5-b691-e919cf068b0d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[272a1c5e-0f2f-4899-9bdc-7d7510b76482]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0, portal: 172.16.0.220,3260]
Nov 11 01:33:13 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-0de82fe7-3964-4b4c-bd3f-a0d12ab3ee76 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-81a28840-6e36-4b21-b07a-48b8e6a6ed48)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74dc1d7-172a-4bd4-b20d-943a1980f80b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver [None req-62251318-1098-4e55-8f62-c9359d46f3c6 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f3644d63-3d0f-46e9-bf65-ca0ac7783f81 could not be found.
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise value
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f3644d63-3d0f-46e9-bf65-ca0ac7783f81 could not be found. (HTTP 404) (Request-ID: req-0fc4998e-91c2-4199-9eb1-c7a9c921cb0c)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f3644d63-3d0f-46e9-bf65-ca0ac7783f81 could not be found.
Nov 11 01:33:13 user nova-compute[75215]: ERROR nova.virt.libvirt.driver 
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-0de82fe7-3964-4b4c-bd3f-a0d12ab3ee76 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] Exception during message handling: KeyError: 'type'
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-62251318-1098-4e55-8f62-c9359d46f3c6 tempest-VolumesAssistedSnapshotsTest-1312409422 tempest-VolumesAssistedSnapshotsTest-1312409422-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise value
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 01:33:13 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa427c66-d1e9-4f18-9bd6-6b51decd41fb]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:13 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.508s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:33:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb456313-602f-4d82-af2e-8a0f3c1a8eaa]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCBmlGQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-95de5a51-cf14-4839-8849-19ec4f0787e6 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 79.495s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4f4e2294-9abd-4c00-a8c2-ef9719eef993 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 79.396s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:14 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca could not be found.
Nov 11 01:33:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uahLfXcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:14 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 01:33:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG os_brick.utils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6365f4dc-5042-4dd4-bd36-258a7947d62f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbacad30-5bc6-4b32-bb47-f808f7274edd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c52d2b-edea-48d5-ab77-c90603f67401]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.557s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] <== connect_volume: return (1559ms) {'type': 'block', 'scsi_wwn': '26261366334616532', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261366334616532', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a397776-0395-4d83-bd80-c319dada7afb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.229s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[358133e8-fae7-417e-9931-d62470f676b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:33:15 user nova-compute[75215]: No targets found.
Nov 11 01:33:15 user nova-compute[75215]: iSNS:
Nov 11 01:33:15 user nova-compute[75215]: No targets found.
Nov 11 01:33:15 user nova-compute[75215]: STATIC:
Nov 11 01:33:15 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f
Nov 11 01:33:15 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:15 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:15 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:33:15 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:15 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:15 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725
Nov 11 01:33:15 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:15 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:15 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133
Nov 11 01:33:15 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:15 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:15 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0
Nov 11 01:33:15 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:33:15 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:33:15 user nova-compute[75215]: FIRMWARE:
Nov 11 01:33:15 user nova-compute[75215]: No targets found.
Nov 11 01:33:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:33:15 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:33:15 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:33:15 user nova-compute[75215]: INFO nova.compute.manager [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Detaching volume f64dd3fc-d120-4c18-b13d-249f7da0f133
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:33:15 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd41df-669e-478d-a479-570f0cd4a4aa]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.utils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updating existing volume attachment record: a2925e2d-1bf0-4937-9b97-7307a155ca06 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d3f865-0c95-491d-a34e-de1166da3d1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lazy-loading 'flavor' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[954671e6-ba47-494d-ac1c-64eef82b5c50]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:15 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:15 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:15 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:15 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:15 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:15 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:15 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:15 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4044534550>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.113s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] <== disconnect_volume: return (342ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:33:15 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:15 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:33:15 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:15 user nova-compute[75215]:   <serial>40cd998c-e8a1-4685-8220-a380137b52b0</serial>
Nov 11 01:33:15 user nova-compute[75215]: </disk>
Nov 11 01:33:15 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid 'ed9354d9-106b-4ca5-8f60-0140c85e74ca' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ed9354d9-106b-4ca5-8f60-0140c85e74ca' (instance-0000000b)
Nov 11 01:33:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:33:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7939MB free_disk=25.54555892944336GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] No VIF found with MAC fa:16:3e:95:05:3a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c7c8d8f5-5e51-4e02-8001-ea843090f471 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a0456c90-8b61-44aa-9484-08d9a481f8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b7244d96-4c01-4a87-b76c-d76ba83e3879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:33:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:33:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:33:17 user nova-compute[75215]: INFO nova.compute.claims [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Claim successful on node user
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:33:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.policy [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44e25bace5db43638b4eedfeb9215e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6fb80bd889f488bbfa25060dca25bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:33:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Creating image(s)
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.264s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:33:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk 1073741824" returned: 0 in 0.071s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Successfully created port: 5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Cannot resize image /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Ensure instance console log exists: /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:33:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Successfully updated port: 5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquired lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-87f4280e-e780-45c3-91b6-44a87fc1caff req-459ea760-ae30-4ecd-b530-c6c715481222 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-changed-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-87f4280e-e780-45c3-91b6-44a87fc1caff req-459ea760-ae30-4ecd-b530-c6c715481222 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Refreshing instance network info cache due to event network-changed-5e151329-5da5-4b43-a1d6-80c5fd4b9818. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-87f4280e-e780-45c3-91b6-44a87fc1caff req-459ea760-ae30-4ecd-b530-c6c715481222 service nova] Acquiring lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Updating instance_info_cache with network_info: [{"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Releasing lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance network_info: |[{"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-87f4280e-e780-45c3-91b6-44a87fc1caff req-459ea760-ae30-4ecd-b530-c6c715481222 service nova] Acquired lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-87f4280e-e780-45c3-91b6-44a87fc1caff req-459ea760-ae30-4ecd-b530-c6c715481222 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Refreshing network info cache for port 5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Start _get_guest_xml network_info=[{"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:33:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:33:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1329016254',display_name='tempest-tempest.common.compute-instance-1329016254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1329016254',id=14,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVPN5anh2XXeiivIGiHtn+WBt+rHOSMg3zh/uez0YkfrvS0adQ5fDROJuNHEVqbieRXHJf3+6tvz110BkRBpXfWJYP78Rb9BHIjC6wlzax3PwmZN+kJ+N61Edfk/zphA==',key_name='tempest-keypair-1076303283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-fqo3dwe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:33:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=5c815cf9-c1d2-496c-b4f3-190dcd19ab98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:33:20 user nova-compute[75215]:   <uuid>5c815cf9-c1d2-496c-b4f3-190dcd19ab98</uuid>
Nov 11 01:33:20 user nova-compute[75215]:   <name>instance-0000000e</name>
Nov 11 01:33:20 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:33:20 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:33:20 user nova-compute[75215]:   <metadata>
Nov 11 01:33:20 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:33:20 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:33:20 user nova-compute[75215]:       <nova:name>tempest-tempest.common.compute-instance-1329016254</nova:name>
Nov 11 01:33:20 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:33:20</nova:creationTime>
Nov 11 01:33:20 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:33:20 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:33:20 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:33:20 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:33:20 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:33:20 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:33:20 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:33:20 user nova-compute[75215]:       <nova:owner>
Nov 11 01:33:20 user nova-compute[75215]:         <nova:user uuid="44e25bace5db43638b4eedfeb9215e24">tempest-ServerActionsTestOtherA-802983068-project-member</nova:user>
Nov 11 01:33:20 user nova-compute[75215]:         <nova:project uuid="c6fb80bd889f488bbfa25060dca25bb8">tempest-ServerActionsTestOtherA-802983068</nova:project>
Nov 11 01:33:20 user nova-compute[75215]:       </nova:owner>
Nov 11 01:33:20 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:33:20 user nova-compute[75215]:       <nova:ports>
Nov 11 01:33:20 user nova-compute[75215]:         <nova:port uuid="5e151329-5da5-4b43-a1d6-80c5fd4b9818">
Nov 11 01:33:20 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 01:33:20 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:20 user nova-compute[75215]:       </nova:ports>
Nov 11 01:33:20 user nova-compute[75215]:     </nova:instance>
Nov 11 01:33:20 user nova-compute[75215]:   </metadata>
Nov 11 01:33:20 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:33:20 user nova-compute[75215]:     <system>
Nov 11 01:33:20 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:33:20 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:33:20 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:33:20 user nova-compute[75215]:       <entry name="serial">5c815cf9-c1d2-496c-b4f3-190dcd19ab98</entry>
Nov 11 01:33:20 user nova-compute[75215]:       <entry name="uuid">5c815cf9-c1d2-496c-b4f3-190dcd19ab98</entry>
Nov 11 01:33:20 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:33:20 user nova-compute[75215]:     </system>
Nov 11 01:33:20 user nova-compute[75215]:   </sysinfo>
Nov 11 01:33:20 user nova-compute[75215]:   <os>
Nov 11 01:33:20 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:33:20 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:33:20 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:33:20 user nova-compute[75215]:   </os>
Nov 11 01:33:20 user nova-compute[75215]:   <features>
Nov 11 01:33:20 user nova-compute[75215]:     <acpi/>
Nov 11 01:33:20 user nova-compute[75215]:     <apic/>
Nov 11 01:33:20 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:33:20 user nova-compute[75215]:   </features>
Nov 11 01:33:20 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:33:20 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:33:20 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:33:20 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:33:20 user nova-compute[75215]:   </clock>
Nov 11 01:33:20 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:33:20 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:33:20 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:33:20 user nova-compute[75215]:   </cpu>
Nov 11 01:33:20 user nova-compute[75215]:   <devices>
Nov 11 01:33:20 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:33:20 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:33:20 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk"/>
Nov 11 01:33:20 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:33:20 user nova-compute[75215]:     </disk>
Nov 11 01:33:20 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:20 user nova-compute[75215]:       <mac address="fa:16:3e:57:cb:70"/>
Nov 11 01:33:20 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:20 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:20 user nova-compute[75215]:       <target dev="tap5e151329-5d"/>
Nov 11 01:33:20 user nova-compute[75215]:     </interface>
Nov 11 01:33:20 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:33:20 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/console.log" append="off"/>
Nov 11 01:33:20 user nova-compute[75215]:     </serial>
Nov 11 01:33:20 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:33:20 user nova-compute[75215]:     <video>
Nov 11 01:33:20 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:20 user nova-compute[75215]:     </video>
Nov 11 01:33:20 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:33:20 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:33:20 user nova-compute[75215]:     </rng>
Nov 11 01:33:20 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:33:20 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:33:20 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:33:20 user nova-compute[75215]:     </memballoon>
Nov 11 01:33:20 user nova-compute[75215]:   </devices>
Nov 11 01:33:20 user nova-compute[75215]: </domain>
Nov 11 01:33:20 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1329016254',display_name='tempest-tempest.common.compute-instance-1329016254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1329016254',id=14,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVPN5anh2XXeiivIGiHtn+WBt+rHOSMg3zh/uez0YkfrvS0adQ5fDROJuNHEVqbieRXHJf3+6tvz110BkRBpXfWJYP78Rb9BHIjC6wlzax3PwmZN+kJ+N61Edfk/zphA==',key_name='tempest-keypair-1076303283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-fqo3dwe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:33:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=5c815cf9-c1d2-496c-b4f3-190dcd19ab98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG os_vif [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2528dfe-da67-569e-9211-6866bb92c16c', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e151329-5d, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e151329-5d, col_values=(('qos', UUID('049e966d-6c6f-4a3c-a103-ffc6f7f3bb0f')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e151329-5d, col_values=(('external_ids', {'iface-id': '5e151329-5da5-4b43-a1d6-80c5fd4b9818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:cb:70', 'vm-uuid': '5c815cf9-c1d2-496c-b4f3-190dcd19ab98'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:20 user nova-compute[75215]: INFO os_vif [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d')
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No VIF found with MAC fa:16:3e:57:cb:70, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-87f4280e-e780-45c3-91b6-44a87fc1caff req-459ea760-ae30-4ecd-b530-c6c715481222 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Updated VIF entry in instance network info cache for port 5e151329-5da5-4b43-a1d6-80c5fd4b9818. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-87f4280e-e780-45c3-91b6-44a87fc1caff req-459ea760-ae30-4ecd-b530-c6c715481222 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Updating instance_info_cache with network_info: [{"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:33:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-87f4280e-e780-45c3-91b6-44a87fc1caff req-459ea760-ae30-4ecd-b530-c6c715481222 service nova] Releasing lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-a2170971-dc0c-499b-a690-08be7add175d req-5d561539-93aa-4fa6-8312-aee4af627d04 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a2170971-dc0c-499b-a690-08be7add175d req-5d561539-93aa-4fa6-8312-aee4af627d04 service nova] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a2170971-dc0c-499b-a690-08be7add175d req-5d561539-93aa-4fa6-8312-aee4af627d04 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a2170971-dc0c-499b-a690-08be7add175d req-5d561539-93aa-4fa6-8312-aee4af627d04 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-a2170971-dc0c-499b-a690-08be7add175d req-5d561539-93aa-4fa6-8312-aee4af627d04 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] No waiting events found dispatching network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:33:22 user nova-compute[75215]: WARNING nova.compute.manager [req-a2170971-dc0c-499b-a690-08be7add175d req-5d561539-93aa-4fa6-8312-aee4af627d04 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received unexpected event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 for instance with vm_state building and task_state spawning.
Nov 11 01:33:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-ad756403-14d9-43ae-8679-c46605222bb9 req-57c1c8a4-0673-40c6-bc8a-ddd9c7964608 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad756403-14d9-43ae-8679-c46605222bb9 req-57c1c8a4-0673-40c6-bc8a-ddd9c7964608 service nova] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad756403-14d9-43ae-8679-c46605222bb9 req-57c1c8a4-0673-40c6-bc8a-ddd9c7964608 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ad756403-14d9-43ae-8679-c46605222bb9 req-57c1c8a4-0673-40c6-bc8a-ddd9c7964608 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-ad756403-14d9-43ae-8679-c46605222bb9 req-57c1c8a4-0673-40c6-bc8a-ddd9c7964608 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] No waiting events found dispatching network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:33:24 user nova-compute[75215]: WARNING nova.compute.manager [req-ad756403-14d9-43ae-8679-c46605222bb9 req-57c1c8a4-0673-40c6-bc8a-ddd9c7964608 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received unexpected event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 for instance with vm_state building and task_state spawning.
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:33:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance spawned successfully.
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:24 user nova-compute[75215]: INFO nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 11 01:33:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:33:24 user nova-compute[75215]: INFO nova.compute.manager [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Took 6.97 seconds to build instance.
Nov 11 01:33:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1e270812-e4c2-4fd6-aef4-08ae8c8f362c tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.080s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:33:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:33:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:33:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:33:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:33:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:33:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqynFHUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:44 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:44 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:44 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6365550-0181-431e-a7ad-d77320d7f0fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:33:44 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1bde96-db90-4239-a391-4f0af2826d47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83] added
Nov 11 01:33:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847ea0d-a681-4310-af3b-44ae34b0bda6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: INFO nova.virt.block_device [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Attempting to driver detach volume f64dd3fc-d120-4c18-b13d-249f7da0f133 from mountpoint /dev/vdb
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Attempting to detach device vdb from instance a0456c90-8b61-44aa-9484-08d9a481f8a7 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] detach device xml: <disk type="block" device="disk">
Nov 11 01:33:44 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:44 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:33:44 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:44 user nova-compute[75215]:   <serial>f64dd3fc-d120-4c18-b13d-249f7da0f133</serial>
Nov 11 01:33:44 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:33:44 user nova-compute[75215]: </disk>
Nov 11 01:33:44 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:33:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Successfully detached device vdb from instance a0456c90-8b61-44aa-9484-08d9a481f8a7 from the persistent domain config.
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0456c90-8b61-44aa-9484-08d9a481f8a7 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] detach device xml: <disk type="block" device="disk">
Nov 11 01:33:44 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:44 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:33:44 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:44 user nova-compute[75215]:   <serial>f64dd3fc-d120-4c18-b13d-249f7da0f133</serial>
Nov 11 01:33:44 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:33:44 user nova-compute[75215]: </disk>
Nov 11 01:33:44 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f453cf-c4ee-47f5-8cb7-6fa93ca46f75]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zqynFHUj {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zqynFHUj" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[631cebc3-6bb8-49ec-8530-ac79d1ca5b32]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zqynFHUj'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9984662b-7ca6-491b-bc22-d49ea32d0077]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fb4209-4c27-4f3e-ad1c-c89d51924804]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5681bf4-245a-430f-86b3-c204d5c1dbf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83, portal: 172.16.0.220,3260]
Nov 11 01:33:44 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aee6ec-1e1f-4269-884e-23589082312e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[71316c50-6326-486f-a63d-bb0f23c8456d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-063a16d8-8ba2-43e2-99e1-f44e46e44750 tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 87.212s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e49bc6-6095-468d-97d2-efb9714006af]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqynFHUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:33:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Creating image(s)
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Ensure instance console log exists: /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Start _get_guest_xml network_info=[{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'a2925e2d-1bf0-4937-9b97-7307a155ca06', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmriZxQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b372f84a-390e-4707-ad3c-8d9f0a7c8327', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5756be5-b549-4aa5-a440-62df68449e6a', 'serial': 'b5756be5-b549-4aa5-a440-62df68449e6a'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:44 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:33:44 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmriZxQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:44 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:44 user nova-compute[75215]: INFO nova.compute.manager [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Detaching volume 5c46c730-c209-4cc7-8954-d909ab621a7f
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0456c90-8b61-44aa-9484-08d9a481f8a7 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lazy-loading 'flavor' on Instance uuid 29f1747f-8209-4d8f-9929-d6227763b5c5 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:44 user nova-compute[75215]: INFO nova.virt.block_device [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Attempting to driver detach volume 5c46c730-c209-4cc7-8954-d909ab621a7f from mountpoint /dev/sdc
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Attempting to detach device sdc from instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:33:44 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:44 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:33:44 user nova-compute[75215]:   <target dev="sdc" bus="scsi"/>
Nov 11 01:33:44 user nova-compute[75215]:   <serial>5c46c730-c209-4cc7-8954-d909ab621a7f</serial>
Nov 11 01:33:44 user nova-compute[75215]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 11 01:33:44 user nova-compute[75215]: </disk>
Nov 11 01:33:44 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:33:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Successfully detached device sdc from instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 from the persistent domain config.
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:33:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:33:44 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:44 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:33:44 user nova-compute[75215]:   <target dev="sdc" bus="scsi"/>
Nov 11 01:33:44 user nova-compute[75215]:   <serial>5c46c730-c209-4cc7-8954-d909ab621a7f</serial>
Nov 11 01:33:44 user nova-compute[75215]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 11 01:33:44 user nova-compute[75215]: </disk>
Nov 11 01:33:44 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:45 user nova-compute[75215]: INFO nova.compute.manager [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Attaching volume 453fb811-8171-4f61-abfc-6161f569140b to /dev/vdb
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e8f5fa-1bac-4ec4-8883-b0a5de6eafe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[df86752a-3b66-46e1-8a29-67b7c0c0ec8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caa4a8a-6e8d-47eb-8b28-a3b144d0aae3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642d72d-f63a-45c0-8d4b-6bb70f6f2a77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: INFO nova.compute.manager [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Detaching volume b38e610e-48de-43e0-8826-95fa276a5725
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:33:45 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[772494c9-08cb-41c1-b800-dd6a8f519c9a]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updating existing volume attachment record: db5ac5ea-97ce-4c7b-904d-b45fc633ced1 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Preparing to wait for external event volume-reimaged-02bab4fc-3d0f-449a-b7a0-ef86c368498c {{(pid=75215) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:45 user nova-compute[75215]: INFO nova.virt.block_device [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Attempting to driver detach volume b38e610e-48de-43e0-8826-95fa276a5725 from mountpoint /dev/vdb
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Attempting to detach device vdb from instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:33:45 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:45 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:33:45 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:45 user nova-compute[75215]:   <serial>b38e610e-48de-43e0-8826-95fa276a5725</serial>
Nov 11 01:33:45 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:33:45 user nova-compute[75215]: </disk>
Nov 11 01:33:45 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:33:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Successfully detached device vdb from instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 from the persistent domain config.
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:33:45 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:45 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:33:45 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:45 user nova-compute[75215]:   <serial>b38e610e-48de-43e0-8826-95fa276a5725</serial>
Nov 11 01:33:45 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:33:45 user nova-compute[75215]: </disk>
Nov 11 01:33:45 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26637353635653034', 'path': '/dev/sdg'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353635653034', 'path': '/dev/sdg'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.778s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:45 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:45 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ea68c-4e24-4636-a055-8eaf3c0a1de1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:33:45 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[13946c2c-f2d4-4236-9705-e129d9209007]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lazy-loading 'flavor' on Instance uuid b58b0c19-8c8a-482b-a693-eb6855ed5dd1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a] added
Nov 11 01:33:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:33:45 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:45 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 11 01:33:45 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:45 user nova-compute[75215]:   <serial>b101360e-a77f-4282-9c80-250fadec0c83</serial>
Nov 11 01:33:45 user nova-compute[75215]: </disk>
Nov 11 01:33:45 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee87ebc-e351-4c91-9175-47cc7d3d8eb2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5097b48-57a5-4034-a172-b1da94d3d070]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmriZxQe {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmriZxQe" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc38c11-f82c-4c6d-8df1-515c32a6c406]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YmriZxQe'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[186fde53-f02f-42e2-93d4-4a6db121abc1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279eefb-ddd0-4fa9-85f8-708eaafa7896]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63414a4-9a7d-4bff-a44b-5bbdfbb830fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a, portal: 172.16.0.220,3260]
Nov 11 01:33:45 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4398c9-c28b-448a-9e8a-adaa1e94dfdd]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ac201-bd0b-4243-bb10-0b751cf0f3a5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a82ce44-322f-4648-8c27-16335431db7f]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:33:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmriZxQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:33:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] No VIF found with MAC fa:16:3e:6d:40:2c, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:33:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-42f75399-2eee-4ce9-8d3d-8e069a285aca tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 89.029s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:46 user nova-compute[75215]: INFO nova.compute.manager [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Detaching volume 40cd998c-e8a1-4685-8220-a380137b52b0
Nov 11 01:33:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] <== connect_volume: return (2185ms) {'type': 'block', 'scsi_wwn': '23935383364343434', 'path': '/dev/sdh'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935383364343434', 'path': '/dev/sdh'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2103065644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2103065644',id=13,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-len87ys3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:32:25Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=b372f84a-390e-4707-ad3c-8d9f0a7c8327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:e5:81,bridge_name='br-int',has_traffic_filtering=True,id=427d21a8-099b-4a97-8428-39ba7ed4d384,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427d21a8-09') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'pci_devices' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:33:47 user nova-compute[75215]:   <uuid>b372f84a-390e-4707-ad3c-8d9f0a7c8327</uuid>
Nov 11 01:33:47 user nova-compute[75215]:   <name>instance-0000000d</name>
Nov 11 01:33:47 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:33:47 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:33:47 user nova-compute[75215]:   <metadata>
Nov 11 01:33:47 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:33:47 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:33:47 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2103065644</nova:name>
Nov 11 01:33:47 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:33:44</nova:creationTime>
Nov 11 01:33:47 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:33:47 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:33:47 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:33:47 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:33:47 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:33:47 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:33:47 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:33:47 user nova-compute[75215]:       <nova:owner>
Nov 11 01:33:47 user nova-compute[75215]:         <nova:user uuid="561ad55121d44be1ab7971a495b9347f">tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member</nova:user>
Nov 11 01:33:47 user nova-compute[75215]:         <nova:project uuid="32564a70b861419eaefcb97cd327088d">tempest-ServerBootFromVolumeStableRescueTest-1327607516</nova:project>
Nov 11 01:33:47 user nova-compute[75215]:       </nova:owner>
Nov 11 01:33:47 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:33:47 user nova-compute[75215]:       <nova:ports>
Nov 11 01:33:47 user nova-compute[75215]:         <nova:port uuid="427d21a8-099b-4a97-8428-39ba7ed4d384">
Nov 11 01:33:47 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:33:47 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:47 user nova-compute[75215]:       </nova:ports>
Nov 11 01:33:47 user nova-compute[75215]:     </nova:instance>
Nov 11 01:33:47 user nova-compute[75215]:   </metadata>
Nov 11 01:33:47 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:33:47 user nova-compute[75215]:     <system>
Nov 11 01:33:47 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:33:47 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:33:47 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:33:47 user nova-compute[75215]:       <entry name="serial">b372f84a-390e-4707-ad3c-8d9f0a7c8327</entry>
Nov 11 01:33:47 user nova-compute[75215]:       <entry name="uuid">b372f84a-390e-4707-ad3c-8d9f0a7c8327</entry>
Nov 11 01:33:47 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:33:47 user nova-compute[75215]:     </system>
Nov 11 01:33:47 user nova-compute[75215]:   </sysinfo>
Nov 11 01:33:47 user nova-compute[75215]:   <os>
Nov 11 01:33:47 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:33:47 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:33:47 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:33:47 user nova-compute[75215]:   </os>
Nov 11 01:33:47 user nova-compute[75215]:   <features>
Nov 11 01:33:47 user nova-compute[75215]:     <acpi/>
Nov 11 01:33:47 user nova-compute[75215]:     <apic/>
Nov 11 01:33:47 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:33:47 user nova-compute[75215]:   </features>
Nov 11 01:33:47 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:33:47 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:33:47 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:33:47 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:33:47 user nova-compute[75215]:   </clock>
Nov 11 01:33:47 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:33:47 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:33:47 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:33:47 user nova-compute[75215]:   </cpu>
Nov 11 01:33:47 user nova-compute[75215]:   <devices>
Nov 11 01:33:47 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:33:47 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:47 user nova-compute[75215]:       <source dev="/dev/sdh"/>
Nov 11 01:33:47 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:33:47 user nova-compute[75215]:       <serial>b5756be5-b549-4aa5-a440-62df68449e6a</serial>
Nov 11 01:33:47 user nova-compute[75215]:     </disk>
Nov 11 01:33:47 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:47 user nova-compute[75215]:       <mac address="fa:16:3e:61:e5:81"/>
Nov 11 01:33:47 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:47 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:47 user nova-compute[75215]:       <target dev="tap427d21a8-09"/>
Nov 11 01:33:47 user nova-compute[75215]:     </interface>
Nov 11 01:33:47 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:33:47 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/console.log" append="off"/>
Nov 11 01:33:47 user nova-compute[75215]:     </serial>
Nov 11 01:33:47 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:33:47 user nova-compute[75215]:     <video>
Nov 11 01:33:47 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:47 user nova-compute[75215]:     </video>
Nov 11 01:33:47 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:33:47 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:33:47 user nova-compute[75215]:     </rng>
Nov 11 01:33:47 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:33:47 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:33:47 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:33:47 user nova-compute[75215]:     </memballoon>
Nov 11 01:33:47 user nova-compute[75215]:   </devices>
Nov 11 01:33:47 user nova-compute[75215]: </domain>
Nov 11 01:33:47 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2103065644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2103065644',id=13,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-len87ys3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:32:25Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=b372f84a-390e-4707-ad3c-8d9f0a7c8327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:e5:81,bridge_name='br-int',has_traffic_filtering=True,id=427d21a8-099b-4a97-8428-39ba7ed4d384,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427d21a8-09') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG os_vif [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:e5:81,bridge_name='br-int',has_traffic_filtering=True,id=427d21a8-099b-4a97-8428-39ba7ed4d384,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427d21a8-09') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:47 user nova-compute[75215]: INFO nova.virt.block_device [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Attempting to driver detach volume 40cd998c-e8a1-4685-8220-a380137b52b0 from mountpoint /dev/vdb
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cc26e90-af9a-5701-a17d-3928a88bb165', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap427d21a8-09, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap427d21a8-09, col_values=(('qos', UUID('9e7d313f-a9a5-46b5-a6a6-028bfd3841e2')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap427d21a8-09, col_values=(('external_ids', {'iface-id': '427d21a8-099b-4a97-8428-39ba7ed4d384', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:e5:81', 'vm-uuid': 'b372f84a-390e-4707-ad3c-8d9f0a7c8327'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Attempting to detach device vdb from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:33:47 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:47 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:33:47 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:47 user nova-compute[75215]:   <serial>40cd998c-e8a1-4685-8220-a380137b52b0</serial>
Nov 11 01:33:47 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 01:33:47 user nova-compute[75215]: </disk>
Nov 11 01:33:47 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Successfully detached device vdb from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 from the persistent domain config.
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:33:47 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:47 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:33:47 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:33:47 user nova-compute[75215]:   <serial>40cd998c-e8a1-4685-8220-a380137b52b0</serial>
Nov 11 01:33:47 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 01:33:47 user nova-compute[75215]: </disk>
Nov 11 01:33:47 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:47 user nova-compute[75215]: INFO os_vif [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:e5:81,bridge_name='br-int',has_traffic_filtering=True,id=427d21a8-099b-4a97-8428-39ba7ed4d384,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427d21a8-09')
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No VIF found with MAC fa:16:3e:61:e5:81, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG os_brick.utils [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65eddfd-a075-4cba-982e-a7d23bf0fdb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5cee6-f4eb-4d33-8c2b-e79c3924aa14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49d57a5-9f84-4b20-b345-605e832f9998]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[877694a3-d828-4e83-aba4-a472c38f3330]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:33:47 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:33:47 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1404cfb5-a458-449c-91e0-82cc46dee7d8]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:33:47 user nova-compute[75215]: DEBUG os_brick.utils [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:47 user nova-compute[75215]: INFO nova.compute.manager [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Swapping volume b101360e-a77f-4282-9c80-250fadec0c83 for caedba0f-a1e4-40a4-a16a-683fcb8df745
Nov 11 01:33:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:33:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-b95b09d3-f4f9-44a0-a327-c7e8bc1a6b41 req-b9af70a4-8d4e-493c-b6ce-af0683dcaa65 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b95b09d3-f4f9-44a0-a327-c7e8bc1a6b41 req-b9af70a4-8d4e-493c-b6ce-af0683dcaa65 service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b95b09d3-f4f9-44a0-a327-c7e8bc1a6b41 req-b9af70a4-8d4e-493c-b6ce-af0683dcaa65 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b95b09d3-f4f9-44a0-a327-c7e8bc1a6b41 req-b9af70a4-8d4e-493c-b6ce-af0683dcaa65 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-b95b09d3-f4f9-44a0-a327-c7e8bc1a6b41 req-b9af70a4-8d4e-493c-b6ce-af0683dcaa65 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:33:49 user nova-compute[75215]: WARNING nova.compute.manager [req-b95b09d3-f4f9-44a0-a327-c7e8bc1a6b41 req-b9af70a4-8d4e-493c-b6ce-af0683dcaa65 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state building and task_state spawning.
Nov 11 01:33:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-523e7569-7a87-4cf4-89a0-0753821ed15a req-baaec2b4-fd30-4633-a31d-d887eb4ded95 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-523e7569-7a87-4cf4-89a0-0753821ed15a req-baaec2b4-fd30-4633-a31d-d887eb4ded95 service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-523e7569-7a87-4cf4-89a0-0753821ed15a req-baaec2b4-fd30-4633-a31d-d887eb4ded95 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-523e7569-7a87-4cf4-89a0-0753821ed15a req-baaec2b4-fd30-4633-a31d-d887eb4ded95 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-523e7569-7a87-4cf4-89a0-0753821ed15a req-baaec2b4-fd30-4633-a31d-d887eb4ded95 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:33:51 user nova-compute[75215]: WARNING nova.compute.manager [req-523e7569-7a87-4cf4-89a0-0753821ed15a req-baaec2b4-fd30-4633-a31d-d887eb4ded95 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state building and task_state spawning.
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:33:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance spawned successfully.
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:33:51 user nova-compute[75215]: INFO nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Took 7.11 seconds to spawn the instance on the hypervisor.
Nov 11 01:33:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:33:51 user nova-compute[75215]: INFO nova.compute.manager [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Took 87.70 seconds to build instance.
Nov 11 01:33:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0a65b36-93cd-4b5d-9862-e8ae5b7d6d2e tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 87.824s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:33:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Creating image(s)
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Ensure instance console log exists: /opt/stack/data/nova/instances/b7244d96-4c01-4a87-b76c-d76ba83e3879/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Start _get_guest_xml network_info=[{"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'c0b502c0-67b6-4d9e-8aef-b79013fdb5ee', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lukYebWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7244d96-4c01-4a87-b76c-d76ba83e3879', 'attached_at': '', 'detached_at': '', 'volume_id': '1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d', 'serial': '1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'fb2f645b-d5db-4cac-9217-092ec3b7bb7e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNEJQCOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7244d96-4c01-4a87-b76c-d76ba83e3879', 'attached_at': '', 'detached_at': '', 'volume_id': '215d826c-552a-4d8e-a079-2cab7f94d56f', 'serial': '215d826c-552a-4d8e-a079-2cab7f94d56f'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b12b4d9f-f7fb-4328-b11b-97cf025cee23', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkluSQhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7244d96-4c01-4a87-b76c-d76ba83e3879', 'attached_at': '', 'detached_at': '', 'volume_id': '44f2dc55-c51f-4c57-9875-308d3a0545df', 'serial': '44f2dc55-c51f-4c57-9875-308d3a0545df'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:33:52 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:33:52 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:33:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lukYebWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:53 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:53 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:53 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195175a-23dc-4002-84e2-7583a3d577d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:33:53 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c50997b-df8e-47f2-b4e9-e623730dca5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d] added
Nov 11 01:33:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25a80bc-8752-4168-b480-f6d6b4ace566]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4cbe67-c189-4087-bacd-856ae12d5b84]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lukYebWP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lukYebWP" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0fcac8-cf40-436c-a0d4-32c9c9590ea0]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lukYebWP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbff2973-4f7f-48d8-804a-132c12a8605e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8434254c-5f05-4c6d-8a69-0d1a4abfbe3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5ccca7-4cb9-4cc0-9686-c32ead993c9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d, portal: 172.16.0.220,3260]
Nov 11 01:33:53 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e0373-29d0-4450-b673-bdfe40e7be98]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fafe303-2a65-4618-a567-f6ad8922cf1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e22416-4fe2-47d0-a406-b396abac1699]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lukYebWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:33:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26161636434643335', 'path': '/dev/sdi'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161636434643335', 'path': '/dev/sdi'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNEJQCOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:54 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:54 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:54 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[817865a7-0bdd-4a8e-b295-371fe0b92bf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:33:54 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff2cadb-e964-4d62-99c1-0367fe23f8c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f] added
Nov 11 01:33:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a6d6a7-59b9-4b43-8dca-b4e65278003a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[98edf7ab-a042-45fd-82aa-ad4da557efab]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNEJQCOF {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNEJQCOF" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[042e1127-da35-492e-9e61-35934396d18e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YNEJQCOF'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4b965-31b6-4f79-ad02-a180265f7f97]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7ffe5f-9583-4b2d-b36d-0e2e37250041]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a7ee3e-d713-46b3-855d-23d675e87a30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f, portal: 172.16.0.220,3260]
Nov 11 01:33:54 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.133s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a2c6a5-e83b-4ea9-9eae-9b73420f428e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1d2f10-1156-45d8-821b-1afa08bb8051]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:54 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.494s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97acbb9-64c8-4a16-8562-a8db41a3534f]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:33:54 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNEJQCOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:33:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.529s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '23837386166643334', 'path': '/dev/sdj'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837386166643334', 'path': '/dev/sdj'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkluSQhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:33:56 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:56 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:33:56 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac36e7-20b5-4252-8ca6-dd1a0ce9c9ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:33:56 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a8037e-624e-4d13-991c-a4531f8bd3f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df] added
Nov 11 01:33:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcefc5b5-60be-4de2-80e8-2e007c3fc441]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bdec14-a0d0-42f1-a137-b20dd4837dc4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkluSQhI {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkluSQhI" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c22695d-1a80-4951-85a8-8e253e56dc3c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TkluSQhI'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f843f5-ed3c-4c88-bbed-160f7b11ad38]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3321265-328b-4578-9d00-a7726765c6e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0002bda1-05da-4e0b-b099-84fe9fce8d2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df, portal: 172.16.0.220,3260]
Nov 11 01:33:56 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df, portal: 172.16.0.220,3260] successful.
Nov 11 01:33:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[56249690-b866-426e-912a-b7701952cb0b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a15803-4efe-4a03-8d9e-037f8066d9a7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:33:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa79a843-f549-4d8d-9df8-0ab63f6c47fd]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:33:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkluSQhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23339666265383434', 'path': '/dev/sdk'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339666265383434', 'path': '/dev/sdk'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:88:3a,bridge_name='br-int',has_traffic_filtering=True,id=7398a138-4e55-4f66-bbb4-15b5984ca9b1,network=Network(8956f526-fecc-4a78-9e49-ee3c054508a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7398a138-4e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d9:60,bridge_name='br-int',has_traffic_filtering=True,id=b026352a-77fc-4695-a7f2-1b5ee72c9bcc,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb026352a-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:26:4c,bridge_name='br-int',has_traffic_filtering=True,id=12ef6d6e-de92-484c-b739-c6b996a087fa,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12ef6d6e-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:3f,bridge_name='br-int',has_traffic_filtering=True,id=142fc2a0-8b74-459d-a5ae-caa1ecfd5745,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142fc2a0-8b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:d6,bridge_name='br-int',has_traffic_filtering=True,id=ebbeba2a-d881-4978-afae-3b5942328ed0,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbeba2a-d8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:68:43,bridge_name='br-int',has_traffic_filtering=True,id=4218d5db-bda9-4828-83b3-bb481228ad92,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4218d5db-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:33:66,bridge_name='br-int',has_traffic_filtering=True,id=4ca5faf6-ab9d-4681-8990-c6a44198dda5,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca5faf6-ab') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lazy-loading 'pci_devices' on Instance uuid b7244d96-4c01-4a87-b76c-d76ba83e3879 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:33:57 user nova-compute[75215]:   <uuid>b7244d96-4c01-4a87-b76c-d76ba83e3879</uuid>
Nov 11 01:33:57 user nova-compute[75215]:   <name>instance-0000000c</name>
Nov 11 01:33:57 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:33:57 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:33:57 user nova-compute[75215]:   <metadata>
Nov 11 01:33:57 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:33:57 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:33:57 user nova-compute[75215]:       <nova:name>tempest-device-tagging-server-1146317401</nova:name>
Nov 11 01:33:57 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:33:52</nova:creationTime>
Nov 11 01:33:57 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:33:57 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:33:57 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:33:57 user nova-compute[75215]:       <nova:owner>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:user uuid="4aa36891e1164546994ea1a2308fab65">tempest-TaggedBootDevicesTest-1248833589-project-member</nova:user>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:project uuid="d6d06db6e47a408d958c8ac0028856ec">tempest-TaggedBootDevicesTest-1248833589</nova:project>
Nov 11 01:33:57 user nova-compute[75215]:       </nova:owner>
Nov 11 01:33:57 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:33:57 user nova-compute[75215]:       <nova:ports>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:port uuid="7398a138-4e55-4f66-bbb4-15b5984ca9b1">
Nov 11 01:33:57 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 01:33:57 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:port uuid="b026352a-77fc-4695-a7f2-1b5ee72c9bcc">
Nov 11 01:33:57 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
Nov 11 01:33:57 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:port uuid="12ef6d6e-de92-484c-b739-c6b996a087fa">
Nov 11 01:33:57 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.63" ipVersion="4"/>
Nov 11 01:33:57 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:port uuid="142fc2a0-8b74-459d-a5ae-caa1ecfd5745">
Nov 11 01:33:57 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Nov 11 01:33:57 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:port uuid="ebbeba2a-d881-4978-afae-3b5942328ed0">
Nov 11 01:33:57 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.51" ipVersion="4"/>
Nov 11 01:33:57 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:port uuid="4218d5db-bda9-4828-83b3-bb481228ad92">
Nov 11 01:33:57 user nova-compute[75215]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 11 01:33:57 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:57 user nova-compute[75215]:         <nova:port uuid="4ca5faf6-ab9d-4681-8990-c6a44198dda5">
Nov 11 01:33:57 user nova-compute[75215]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 11 01:33:57 user nova-compute[75215]:         </nova:port>
Nov 11 01:33:57 user nova-compute[75215]:       </nova:ports>
Nov 11 01:33:57 user nova-compute[75215]:     </nova:instance>
Nov 11 01:33:57 user nova-compute[75215]:   </metadata>
Nov 11 01:33:57 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:33:57 user nova-compute[75215]:     <system>
Nov 11 01:33:57 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:33:57 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:33:57 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:33:57 user nova-compute[75215]:       <entry name="serial">b7244d96-4c01-4a87-b76c-d76ba83e3879</entry>
Nov 11 01:33:57 user nova-compute[75215]:       <entry name="uuid">b7244d96-4c01-4a87-b76c-d76ba83e3879</entry>
Nov 11 01:33:57 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:33:57 user nova-compute[75215]:     </system>
Nov 11 01:33:57 user nova-compute[75215]:   </sysinfo>
Nov 11 01:33:57 user nova-compute[75215]:   <os>
Nov 11 01:33:57 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:33:57 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:33:57 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:33:57 user nova-compute[75215]:   </os>
Nov 11 01:33:57 user nova-compute[75215]:   <features>
Nov 11 01:33:57 user nova-compute[75215]:     <acpi/>
Nov 11 01:33:57 user nova-compute[75215]:     <apic/>
Nov 11 01:33:57 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:33:57 user nova-compute[75215]:   </features>
Nov 11 01:33:57 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:33:57 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:33:57 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:33:57 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:33:57 user nova-compute[75215]:   </clock>
Nov 11 01:33:57 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:33:57 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:33:57 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:33:57 user nova-compute[75215]:   </cpu>
Nov 11 01:33:57 user nova-compute[75215]:   <devices>
Nov 11 01:33:57 user nova-compute[75215]:     <disk type="file" device="cdrom">
Nov 11 01:33:57 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none"/>
Nov 11 01:33:57 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/b7244d96-4c01-4a87-b76c-d76ba83e3879/disk.config"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="hda" bus="ide"/>
Nov 11 01:33:57 user nova-compute[75215]:     </disk>
Nov 11 01:33:57 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:33:57 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:57 user nova-compute[75215]:       <source dev="/dev/sdi"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <serial>1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d</serial>
Nov 11 01:33:57 user nova-compute[75215]:     </disk>
Nov 11 01:33:57 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:33:57 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:57 user nova-compute[75215]:       <source dev="/dev/sdj"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <serial>215d826c-552a-4d8e-a079-2cab7f94d56f</serial>
Nov 11 01:33:57 user nova-compute[75215]:     </disk>
Nov 11 01:33:57 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:33:57 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:33:57 user nova-compute[75215]:       <source dev="/dev/sdk"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="vdc" bus="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <serial>44f2dc55-c51f-4c57-9875-308d3a0545df</serial>
Nov 11 01:33:57 user nova-compute[75215]:     </disk>
Nov 11 01:33:57 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:57 user nova-compute[75215]:       <mac address="fa:16:3e:86:88:3a"/>
Nov 11 01:33:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="tap7398a138-4e"/>
Nov 11 01:33:57 user nova-compute[75215]:     </interface>
Nov 11 01:33:57 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:57 user nova-compute[75215]:       <mac address="fa:16:3e:dd:d9:60"/>
Nov 11 01:33:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="tapb026352a-77"/>
Nov 11 01:33:57 user nova-compute[75215]:     </interface>
Nov 11 01:33:57 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:57 user nova-compute[75215]:       <mac address="fa:16:3e:6b:26:4c"/>
Nov 11 01:33:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="tap12ef6d6e-de"/>
Nov 11 01:33:57 user nova-compute[75215]:     </interface>
Nov 11 01:33:57 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:57 user nova-compute[75215]:       <mac address="fa:16:3e:87:98:3f"/>
Nov 11 01:33:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="tap142fc2a0-8b"/>
Nov 11 01:33:57 user nova-compute[75215]:     </interface>
Nov 11 01:33:57 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:57 user nova-compute[75215]:       <mac address="fa:16:3e:e0:21:d6"/>
Nov 11 01:33:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="tapebbeba2a-d8"/>
Nov 11 01:33:57 user nova-compute[75215]:     </interface>
Nov 11 01:33:57 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:57 user nova-compute[75215]:       <mac address="fa:16:3e:bd:68:43"/>
Nov 11 01:33:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="tap4218d5db-bd"/>
Nov 11 01:33:57 user nova-compute[75215]:     </interface>
Nov 11 01:33:57 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:33:57 user nova-compute[75215]:       <mac address="fa:16:3e:24:33:66"/>
Nov 11 01:33:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:33:57 user nova-compute[75215]:       <target dev="tap4ca5faf6-ab"/>
Nov 11 01:33:57 user nova-compute[75215]:     </interface>
Nov 11 01:33:57 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:33:57 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/b7244d96-4c01-4a87-b76c-d76ba83e3879/console.log" append="off"/>
Nov 11 01:33:57 user nova-compute[75215]:     </serial>
Nov 11 01:33:57 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:33:57 user nova-compute[75215]:     <video>
Nov 11 01:33:57 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:33:57 user nova-compute[75215]:     </video>
Nov 11 01:33:57 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:33:57 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:33:57 user nova-compute[75215]:     </rng>
Nov 11 01:33:57 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:33:57 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:33:57 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:33:57 user nova-compute[75215]:     </memballoon>
Nov 11 01:33:57 user nova-compute[75215]:   </devices>
Nov 11 01:33:57 user nova-compute[75215]: </domain>
Nov 11 01:33:57 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:88:3a,bridge_name='br-int',has_traffic_filtering=True,id=7398a138-4e55-4f66-bbb4-15b5984ca9b1,network=Network(8956f526-fecc-4a78-9e49-ee3c054508a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7398a138-4e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:88:3a,bridge_name='br-int',has_traffic_filtering=True,id=7398a138-4e55-4f66-bbb4-15b5984ca9b1,network=Network(8956f526-fecc-4a78-9e49-ee3c054508a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7398a138-4e') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb1f134b-efec-5a72-9e63-629e78ed7a63', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7398a138-4e, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7398a138-4e, col_values=(('qos', UUID('608721eb-f432-446d-a7e0-9d002ff8c1b2')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7398a138-4e, col_values=(('external_ids', {'iface-id': '7398a138-4e55-4f66-bbb4-15b5984ca9b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:88:3a', 'vm-uuid': 'b7244d96-4c01-4a87-b76c-d76ba83e3879'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: INFO os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:88:3a,bridge_name='br-int',has_traffic_filtering=True,id=7398a138-4e55-4f66-bbb4-15b5984ca9b1,network=Network(8956f526-fecc-4a78-9e49-ee3c054508a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7398a138-4e')
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d9:60,bridge_name='br-int',has_traffic_filtering=True,id=b026352a-77fc-4695-a7f2-1b5ee72c9bcc,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb026352a-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d9:60,bridge_name='br-int',has_traffic_filtering=True,id=b026352a-77fc-4695-a7f2-1b5ee72c9bcc,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb026352a-77') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1033c47e-aaec-5c95-9c0e-522574316d35', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb026352a-77, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb026352a-77, col_values=(('qos', UUID('3ec230f8-9603-4a10-abec-4309f78a82ff')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb026352a-77, col_values=(('external_ids', {'iface-id': 'b026352a-77fc-4695-a7f2-1b5ee72c9bcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:d9:60', 'vm-uuid': 'b7244d96-4c01-4a87-b76c-d76ba83e3879'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: INFO os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d9:60,bridge_name='br-int',has_traffic_filtering=True,id=b026352a-77fc-4695-a7f2-1b5ee72c9bcc,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb026352a-77')
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:26:4c,bridge_name='br-int',has_traffic_filtering=True,id=12ef6d6e-de92-484c-b739-c6b996a087fa,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12ef6d6e-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:26:4c,bridge_name='br-int',has_traffic_filtering=True,id=12ef6d6e-de92-484c-b739-c6b996a087fa,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12ef6d6e-de') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65c9b34f-53b4-55d4-aac1-b26749dc701f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12ef6d6e-de, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12ef6d6e-de, col_values=(('qos', UUID('58f44af3-29b7-48b5-81dc-023603c04f35')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12ef6d6e-de, col_values=(('external_ids', {'iface-id': '12ef6d6e-de92-484c-b739-c6b996a087fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:26:4c', 'vm-uuid': 'b7244d96-4c01-4a87-b76c-d76ba83e3879'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: INFO os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:26:4c,bridge_name='br-int',has_traffic_filtering=True,id=12ef6d6e-de92-484c-b739-c6b996a087fa,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12ef6d6e-de')
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:3f,bridge_name='br-int',has_traffic_filtering=True,id=142fc2a0-8b74-459d-a5ae-caa1ecfd5745,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142fc2a0-8b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:3f,bridge_name='br-int',has_traffic_filtering=True,id=142fc2a0-8b74-459d-a5ae-caa1ecfd5745,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142fc2a0-8b') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a6a7219-2ade-5519-a686-cad2cc2da814', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap142fc2a0-8b, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap142fc2a0-8b, col_values=(('qos', UUID('681a00d7-744b-45d8-abfd-21e1a3bf8dd2')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap142fc2a0-8b, col_values=(('external_ids', {'iface-id': '142fc2a0-8b74-459d-a5ae-caa1ecfd5745', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:98:3f', 'vm-uuid': 'b7244d96-4c01-4a87-b76c-d76ba83e3879'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: INFO os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:3f,bridge_name='br-int',has_traffic_filtering=True,id=142fc2a0-8b74-459d-a5ae-caa1ecfd5745,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142fc2a0-8b')
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:d6,bridge_name='br-int',has_traffic_filtering=True,id=ebbeba2a-d881-4978-afae-3b5942328ed0,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbeba2a-d8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:d6,bridge_name='br-int',has_traffic_filtering=True,id=ebbeba2a-d881-4978-afae-3b5942328ed0,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbeba2a-d8') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9e58038-25eb-589c-8c24-49e37ca33f57', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebbeba2a-d8, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebbeba2a-d8, col_values=(('qos', UUID('e70eb178-9b66-45c8-8d19-72a793e99744')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebbeba2a-d8, col_values=(('external_ids', {'iface-id': 'ebbeba2a-d881-4978-afae-3b5942328ed0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:21:d6', 'vm-uuid': 'b7244d96-4c01-4a87-b76c-d76ba83e3879'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: INFO os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:d6,bridge_name='br-int',has_traffic_filtering=True,id=ebbeba2a-d881-4978-afae-3b5942328ed0,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbeba2a-d8')
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:68:43,bridge_name='br-int',has_traffic_filtering=True,id=4218d5db-bda9-4828-83b3-bb481228ad92,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4218d5db-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:68:43,bridge_name='br-int',has_traffic_filtering=True,id=4218d5db-bda9-4828-83b3-bb481228ad92,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4218d5db-bd') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee057747-482c-5756-a5a1-ce78d82a4f7d', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4218d5db-bd, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4218d5db-bd, col_values=(('qos', UUID('8761a0b8-c674-4372-af28-c05bd58868c4')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4218d5db-bd, col_values=(('external_ids', {'iface-id': '4218d5db-bda9-4828-83b3-bb481228ad92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:68:43', 'vm-uuid': 'b7244d96-4c01-4a87-b76c-d76ba83e3879'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: INFO os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:68:43,bridge_name='br-int',has_traffic_filtering=True,id=4218d5db-bda9-4828-83b3-bb481228ad92,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4218d5db-bd')
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:33:66,bridge_name='br-int',has_traffic_filtering=True,id=4ca5faf6-ab9d-4681-8990-c6a44198dda5,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca5faf6-ab') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:33:66,bridge_name='br-int',has_traffic_filtering=True,id=4ca5faf6-ab9d-4681-8990-c6a44198dda5,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca5faf6-ab') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc536768-8c74-5f95-a641-5f9a2aeabaed', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ca5faf6-ab, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ca5faf6-ab, col_values=(('qos', UUID('b63c0f55-f1fb-4067-8b86-5874addddb96')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ca5faf6-ab, col_values=(('external_ids', {'iface-id': '4ca5faf6-ab9d-4681-8990-c6a44198dda5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:33:66', 'vm-uuid': 'b7244d96-4c01-4a87-b76c-d76ba83e3879'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:33:58 user nova-compute[75215]: INFO os_vif [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:33:66,bridge_name='br-int',has_traffic_filtering=True,id=4ca5faf6-ab9d-4681-8990-c6a44198dda5,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca5faf6-ab')
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] No VIF found with MAC fa:16:3e:86:88:3a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] No VIF found with MAC fa:16:3e:e0:21:d6, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:33:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Using config drive
Nov 11 01:33:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Creating config drive at /opt/stack/data/nova/instances/b7244d96-4c01-4a87-b76c-d76ba83e3879/disk.config
Nov 11 01:33:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b7244d96-4c01-4a87-b76c-d76ba83e3879/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp29p4ap4l {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:33:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b7244d96-4c01-4a87-b76c-d76ba83e3879/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp29p4ap4l" returned: 0 in 0.072s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-1a07871b-82ec-4585-9701-869bcbfaf6a7 req-7c2046ae-4b79-434b-b3fa-12046f362a52 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1a07871b-82ec-4585-9701-869bcbfaf6a7 req-7c2046ae-4b79-434b-b3fa-12046f362a52 service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1a07871b-82ec-4585-9701-869bcbfaf6a7 req-7c2046ae-4b79-434b-b3fa-12046f362a52 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1a07871b-82ec-4585-9701-869bcbfaf6a7 req-7c2046ae-4b79-434b-b3fa-12046f362a52 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-1a07871b-82ec-4585-9701-869bcbfaf6a7 req-7c2046ae-4b79-434b-b3fa-12046f362a52 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:00 user nova-compute[75215]: WARNING nova.compute.manager [req-1a07871b-82ec-4585-9701-869bcbfaf6a7 req-7c2046ae-4b79-434b-b3fa-12046f362a52 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 for instance with vm_state building and task_state spawning.
Nov 11 01:34:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-67f15cab-7a57-4de9-aca3-591c07f9c65a req-ecb8a100-8d1e-4485-b7b5-4981ade42158 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-67f15cab-7a57-4de9-aca3-591c07f9c65a req-ecb8a100-8d1e-4485-b7b5-4981ade42158 service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-67f15cab-7a57-4de9-aca3-591c07f9c65a req-ecb8a100-8d1e-4485-b7b5-4981ade42158 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-67f15cab-7a57-4de9-aca3-591c07f9c65a req-ecb8a100-8d1e-4485-b7b5-4981ade42158 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-67f15cab-7a57-4de9-aca3-591c07f9c65a req-ecb8a100-8d1e-4485-b7b5-4981ade42158 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:01 user nova-compute[75215]: WARNING nova.compute.manager [req-67f15cab-7a57-4de9-aca3-591c07f9c65a req-ecb8a100-8d1e-4485-b7b5-4981ade42158 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc for instance with vm_state building and task_state spawning.
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-06fba405-068a-4f0b-9b45-ea2cf9c6d035 req-b8511d15-eaae-48e0-9e2b-cc9c603f6454 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-06fba405-068a-4f0b-9b45-ea2cf9c6d035 req-b8511d15-eaae-48e0-9e2b-cc9c603f6454 service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-06fba405-068a-4f0b-9b45-ea2cf9c6d035 req-b8511d15-eaae-48e0-9e2b-cc9c603f6454 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-06fba405-068a-4f0b-9b45-ea2cf9c6d035 req-b8511d15-eaae-48e0-9e2b-cc9c603f6454 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-06fba405-068a-4f0b-9b45-ea2cf9c6d035 req-b8511d15-eaae-48e0-9e2b-cc9c603f6454 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:01 user nova-compute[75215]: WARNING nova.compute.manager [req-06fba405-068a-4f0b-9b45-ea2cf9c6d035 req-b8511d15-eaae-48e0-9e2b-cc9c603f6454 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa for instance with vm_state building and task_state spawning.
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:02 user nova-compute[75215]: WARNING nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 for instance with vm_state building and task_state spawning.
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:02 user nova-compute[75215]: WARNING nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 for instance with vm_state building and task_state spawning.
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:02 user nova-compute[75215]: WARNING nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 for instance with vm_state building and task_state spawning.
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:02 user nova-compute[75215]: WARNING nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 for instance with vm_state building and task_state spawning.
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:02 user nova-compute[75215]: WARNING nova.compute.manager [req-1db9bd9c-3540-49a7-b1bc-921ae3522b1a req-a03c36af-2c9b-4aa8-9396-d5b89b14914b service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 for instance with vm_state building and task_state spawning.
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-5b435d02-f35a-43db-9cb3-e3ef493f7640 req-7476d455-d1af-484e-a167-912c924e1370 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b435d02-f35a-43db-9cb3-e3ef493f7640 req-7476d455-d1af-484e-a167-912c924e1370 service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b435d02-f35a-43db-9cb3-e3ef493f7640 req-7476d455-d1af-484e-a167-912c924e1370 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b435d02-f35a-43db-9cb3-e3ef493f7640 req-7476d455-d1af-484e-a167-912c924e1370 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-5b435d02-f35a-43db-9cb3-e3ef493f7640 req-7476d455-d1af-484e-a167-912c924e1370 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:03 user nova-compute[75215]: WARNING nova.compute.manager [req-5b435d02-f35a-43db-9cb3-e3ef493f7640 req-7476d455-d1af-484e-a167-912c924e1370 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc for instance with vm_state building and task_state spawning.
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:03 user nova-compute[75215]: WARNING nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa for instance with vm_state building and task_state spawning.
Nov 11 01:34:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:03 user nova-compute[75215]: WARNING nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 for instance with vm_state building and task_state spawning.
Nov 11 01:34:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:03 user nova-compute[75215]: WARNING nova.compute.manager [req-3d9d4e20-0ad7-44dc-9e43-531aceeb9e9b req-0d30942d-131f-4a0b-9720-2d6748fa36ea service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 for instance with vm_state building and task_state spawning.
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a0456c90-8b61-44aa-9484-08d9a481f8a7 is timed out.
Nov 11 01:34:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Successfully detached device vdb from instance a0456c90-8b61-44aa-9484-08d9a481f8a7 from the live domain config.
Nov 11 01:34:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PArUaylq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:34:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a28fa5-48ba-4b49-8d48-eef3a58788df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:34:04 user nova-compute[75215]: No targets found.
Nov 11 01:34:04 user nova-compute[75215]: iSNS:
Nov 11 01:34:04 user nova-compute[75215]: No targets found.
Nov 11 01:34:04 user nova-compute[75215]: STATIC:
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0
Nov 11 01:34:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:04 user nova-compute[75215]: FIRMWARE:
Nov 11 01:34:04 user nova-compute[75215]: No targets found.
Nov 11 01:34:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:34:04 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:34:04 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:04 user nova-compute[75215]: WARNING nova.compute.manager [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 for instance with vm_state building and task_state spawning.
Nov 11 01:34:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:04 user nova-compute[75215]: WARNING nova.compute.manager [req-7bb65dac-f51f-41b9-b82a-3fa50f51da37 req-ef87fe53-d741-4e49-9a4a-e660b808f60f service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 for instance with vm_state building and task_state spawning.
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63cc270-6969-45c6-8301-1a571117987d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c979ef2-5a9c-4d60-8c49-2f21fb60409d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:34:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4044488ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2a707f-a971-4eef-a1e8-8708c57c1a60]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f081b39b-c4c3-4b80-92f3-4baf357d1d02]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3690a7f1-1a58-45e6-96db-c458dfa68d09]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:34:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ead3b53-d4b2-42f2-b5f3-6fc1f4733f6a]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance spawned successfully.
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df77859-d87f-4a33-9bd9-437e8f9a1586]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[636055a1-d8c2-4cf4-b392-63845d8f3dd7]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133, portal: 172.16.0.220,3260]
Nov 11 01:34:05 user nova-compute[75215]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133, portal: 172.16.0.220,3260] successful.
Nov 11 01:34:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64dd3fc-d120-4c18-b13d-249f7da0f133 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf95a9b-3bcd-41a8-8b89-488001cd0b2a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] <== disconnect_volume: return (389ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:34:05 user nova-compute[75215]: INFO nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Took 12.27 seconds to spawn the instance on the hypervisor.
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:34:05 user nova-compute[75215]: INFO nova.compute.manager [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Took 160.48 seconds to build instance.
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5dd8fa72-9b95-4a76-9fe2-a2fa669b75b8 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 160.592s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 is timed out.
Nov 11 01:34:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Successfully detached device sdc from instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 from the live domain config.
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDaKzwYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:34:05 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa797bcb-4ce9-45c4-98bd-9c70f8257d9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:34:05 user nova-compute[75215]: No targets found.
Nov 11 01:34:05 user nova-compute[75215]: iSNS:
Nov 11 01:34:05 user nova-compute[75215]: No targets found.
Nov 11 01:34:05 user nova-compute[75215]: STATIC:
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: FIRMWARE:
Nov 11 01:34:05 user nova-compute[75215]: No targets found.
Nov 11 01:34:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:34:05 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:34:05 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2fc202-2166-47fa-9f5c-e76338d6648e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a406dd6b-4ed0-4077-be03-29f78bbff83a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:34:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:34:05 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:34:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4064665120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f'): ({'sdf'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Removing single pathed devices sdf {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.096s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff98ed6-af73-43f7-8f4f-03a7e4a149db]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1b0160-ec38-4f70-89fa-32ab9e38f04c]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Flushing IO for device /dev/sdf {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc9510-ea58-4ea0-a3c4-bcd74c40d917]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac099371-902a-4abb-9277-268df3fc399f]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f27063a-33d7-4c15-8061-e3c3f218a1a1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1534278b-1de8-4455-b156-45bf6f67fd09]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f, portal: 172.16.0.220,3260]
Nov 11 01:34:05 user nova-compute[75215]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f, portal: 172.16.0.220,3260] successful.
Nov 11 01:34:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 is timed out.
Nov 11 01:34:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Successfully detached device vdb from instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 from the live domain config.
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMTYqVie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:34:05 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46c730-c209-4cc7-8954-d909ab621a7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbfacb6-ccf9-484c-8cb4-d9156cc85fcc]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.497s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] <== disconnect_volume: return (499ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.023s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af22b187-66f6-492a-b15f-932161d36639]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:34:05 user nova-compute[75215]: No targets found.
Nov 11 01:34:05 user nova-compute[75215]: iSNS:
Nov 11 01:34:05 user nova-compute[75215]: No targets found.
Nov 11 01:34:05 user nova-compute[75215]: STATIC:
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0
Nov 11 01:34:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:05 user nova-compute[75215]: FIRMWARE:
Nov 11 01:34:05 user nova-compute[75215]: No targets found.
Nov 11 01:34:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:34:05 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:34:05 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:34:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a25ceea-e336-429e-992e-89fa0ccbd600]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30bee4c-27f6-4e71-a0f4-e426f0716656]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:34:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:34:06 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:34:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40444f3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e5aa72-2066-44f1-90f4-bc159e71441f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[864bf790-2681-4320-a3be-38d5b932308f]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d827bf22-d039-44c8-859a-f04176d12f3d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb54598-d6ac-4ca2-96c4-0417c16e1fc6]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5905fde2-8d07-4456-8c34-d3697dd5aaf1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58127fd-80b2-45e7-99e8-b132decfb490]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725, portal: 172.16.0.220,3260]
Nov 11 01:34:06 user nova-compute[75215]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725, portal: 172.16.0.220,3260] successful.
Nov 11 01:34:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38e610e-48de-43e0-8826-95fa276a5725 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[897a3a9a-ba4f-43f2-9890-a64528cd5797]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] <== disconnect_volume: return (431ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lazy-loading 'flavor' on Instance uuid a0456c90-8b61-44aa-9484-08d9a481f8a7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d32890cf-80fa-442e-91f1-3fec04aa2380 tempest-VolumesAssistedSnapshotsTest-491109338 tempest-VolumesAssistedSnapshotsTest-491109338-project-admin] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 51.591s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.volume.cinder [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] Update attachment failed for attachment a937f484-4f8e-428a-835e-9bfb6613df13. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18d4e340-683c-48b2-93ba-48ab9d55907c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18d4e340-683c-48b2-93ba-48ab9d55907c)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Failed to connect to volume caedba0f-a1e4-40a4-a16a-683fcb8df745 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18d4e340-683c-48b2-93ba-48ab9d55907c)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Traceback (most recent call last):
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     new_cinfo = self.volume_api.attachment_update(
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     res = method(self, ctx, *args, **kwargs)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     with excutils.save_and_reraise_exception():
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     self.force_reraise()
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     raise self.value
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     context, '3.44', skip_version_check=True).attachments.update(
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     return method.func(obj, *args, **kwargs)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     resp = self._update('/attachments/%s' % id, body)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     return self._cs_request(url, 'PUT', **kwargs)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     return self.request(url, method, **kwargs)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1]     raise exceptions.from_response(resp, body)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18d4e340-683c-48b2-93ba-48ab9d55907c)
Nov 11 01:34:07 user nova-compute[75215]: ERROR nova.compute.manager [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] 
Nov 11 01:34:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lazy-loading 'flavor' on Instance uuid 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:07 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 is timed out.
Nov 11 01:34:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Successfully detached device vdb from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 from the live domain config.
Nov 11 01:34:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCBmlGQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:34:07 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:34:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02989625-a0e2-4521-8de5-542bb2305b61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:34:07 user nova-compute[75215]: No targets found.
Nov 11 01:34:07 user nova-compute[75215]: iSNS:
Nov 11 01:34:07 user nova-compute[75215]: No targets found.
Nov 11 01:34:07 user nova-compute[75215]: STATIC:
Nov 11 01:34:07 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:34:07 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:07 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:07 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:34:07 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:07 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:07 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:34:07 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:07 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:07 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d
Nov 11 01:34:07 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:07 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:07 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:34:07 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:07 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:07 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:34:07 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:07 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:07 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0
Nov 11 01:34:07 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:34:07 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:34:07 user nova-compute[75215]: FIRMWARE:
Nov 11 01:34:07 user nova-compute[75215]: No targets found.
Nov 11 01:34:07 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:34:07 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:34:07 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1f6a2e43-a246-496a-86db-ae47a5acd1ad tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.271s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b7727-7215-49f2-81e5-c6b25a4b240e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0127bc56-b6ce-4aae-bd64-04edd97aaf49]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:34:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 (non-flash)
Nov 11 01:34:08 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:34:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40647455a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc26bbf-4891-4de4-87d0-aa35322061ae]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9851c7-f7f8-4394-9332-8d7b39499120]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b3b5e5-66a2-4f38-861d-e527da500277]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b696b8cc-2daf-4467-a0b8-bab7a183c045]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d12583-f7fc-4ffa-896f-09a9dd907a47]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[03316721-ffee-4cf8-91d8-cfd5b77113d5]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0, portal: 172.16.0.220,3260]
Nov 11 01:34:08 user nova-compute[75215]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0, portal: 172.16.0.220,3260] successful.
Nov 11 01:34:08 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40cd998c-e8a1-4685-8220-a380137b52b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1d9821-11ba-408d-82dc-3d0ce6d29f34]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] <== disconnect_volume: return (368ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:34:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.964s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-1da5d64b-d6d5-4dcc-b161-c653f37690e7 tempest-TestVolumeSwap-28590539 tempest-TestVolumeSwap-28590539-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18d4e340-683c-48b2-93ba-48ab9d55907c)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18d4e340-683c-48b2-93ba-48ab9d55907c)
Nov 11 01:34:08 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 11 01:34:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lazy-loading 'flavor' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b55871b-6d86-48ee-a4da-c7f0f061089d tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.946s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "interface-c7c8d8f5-5e51-4e02-8001-ea843090f471-76a7c0e1-3978-4f0a-825a-bf6bd5f36095" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "interface-c7c8d8f5-5e51-4e02-8001-ea843090f471-76a7c0e1-3978-4f0a-825a-bf6bd5f36095" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:09 user nova-compute[75215]: INFO nova.compute.manager [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Terminating instance
Nov 11 01:34:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lazy-loading 'flavor' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converting VIF {"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:34:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Attempting to detach device tap76a7c0e1-39 from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] detach device xml: <interface type="ethernet">
Nov 11 01:34:10 user nova-compute[75215]:   <mac address="fa:16:3e:45:5a:32"/>
Nov 11 01:34:10 user nova-compute[75215]:   <model type="virtio"/>
Nov 11 01:34:10 user nova-compute[75215]:   <mtu size="1442"/>
Nov 11 01:34:10 user nova-compute[75215]:   <target dev="tap76a7c0e1-39"/>
Nov 11 01:34:10 user nova-compute[75215]: </interface>
Nov 11 01:34:10 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 11 01:34:10 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 11 01:34:10 user nova-compute[75215]:   <uuid>c7c8d8f5-5e51-4e02-8001-ea843090f471</uuid>
Nov 11 01:34:10 user nova-compute[75215]:   <metadata>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:34:10 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 11 01:34:10 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-1881855644</nova:name>
Nov 11 01:34:10 user nova-compute[75215]:   <nova:creationTime>2023-11-11 01:31:55</nova:creationTime>
Nov 11 01:34:10 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 11 01:34:10 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 11 01:34:10 user nova-compute[75215]:   </nova:flavor>
Nov 11 01:34:10 user nova-compute[75215]:   <nova:owner>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:user uuid="6269f798c52c45ee9ca9aa29a4487798">tempest-TaggedAttachmentsTest-1511763889-project-member</nova:user>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:project uuid="e369e597968643269939d15256b6ae97">tempest-TaggedAttachmentsTest-1511763889</nova:project>
Nov 11 01:34:10 user nova-compute[75215]:   </nova:owner>
Nov 11 01:34:10 user nova-compute[75215]:   <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:34:10 user nova-compute[75215]:   <nova:ports>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:port uuid="997c39fb-7e21-4af1-acf2-e0e70157b02d">
Nov 11 01:34:10 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:34:10 user nova-compute[75215]:     </nova:port>
Nov 11 01:34:10 user nova-compute[75215]:     <nova:port uuid="76a7c0e1-3978-4f0a-825a-bf6bd5f36095">
Nov 11 01:34:10 user nova-compute[75215]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Nov 11 01:34:10 user nova-compute[75215]:     </nova:port>
Nov 11 01:34:10 user nova-compute[75215]:   </nova:ports>
Nov 11 01:34:10 user nova-compute[75215]: </nova:instance>
Nov 11 01:34:10 user nova-compute[75215]:   </metadata>
Nov 11 01:34:10 user nova-compute[75215]:   <memory unit='KiB'>524288</memory>
Nov 11 01:34:10 user nova-compute[75215]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 11 01:34:10 user nova-compute[75215]:   <vcpu placement='static'>1</vcpu>
Nov 11 01:34:10 user nova-compute[75215]:   <resource>
Nov 11 01:34:10 user nova-compute[75215]:     <partition>/machine</partition>
Nov 11 01:34:10 user nova-compute[75215]:   </resource>
Nov 11 01:34:10 user nova-compute[75215]:   <sysinfo type='smbios'>
Nov 11 01:34:10 user nova-compute[75215]:     <system>
Nov 11 01:34:10 user nova-compute[75215]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 11 01:34:10 user nova-compute[75215]:       <entry name='product'>OpenStack Nova</entry>
Nov 11 01:34:10 user nova-compute[75215]:       <entry name='version'>0.0.0</entry>
Nov 11 01:34:10 user nova-compute[75215]:       <entry name='serial'>c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:34:10 user nova-compute[75215]:       <entry name='uuid'>c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:34:10 user nova-compute[75215]:       <entry name='family'>Virtual Machine</entry>
Nov 11 01:34:10 user nova-compute[75215]:     </system>
Nov 11 01:34:10 user nova-compute[75215]:   </sysinfo>
Nov 11 01:34:10 user nova-compute[75215]:   <os>
Nov 11 01:34:10 user nova-compute[75215]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 11 01:34:10 user nova-compute[75215]:     <boot dev='hd'/>
Nov 11 01:34:10 user nova-compute[75215]:     <smbios mode='sysinfo'/>
Nov 11 01:34:10 user nova-compute[75215]:   </os>
Nov 11 01:34:10 user nova-compute[75215]:   <features>
Nov 11 01:34:10 user nova-compute[75215]:     <acpi/>
Nov 11 01:34:10 user nova-compute[75215]:     <apic/>
Nov 11 01:34:10 user nova-compute[75215]:     <vmcoreinfo state='on'/>
Nov 11 01:34:10 user nova-compute[75215]:   </features>
Nov 11 01:34:10 user nova-compute[75215]:   <cpu mode='custom' match='exact' check='full'>
Nov 11 01:34:10 user nova-compute[75215]:     <model fallback='forbid'>Nehalem</model>
Nov 11 01:34:10 user nova-compute[75215]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 11 01:34:10 user nova-compute[75215]:     <feature policy='require' name='vme'/>
Nov 11 01:34:10 user nova-compute[75215]:     <feature policy='require' name='x2apic'/>
Nov 11 01:34:10 user nova-compute[75215]:     <feature policy='require' name='hypervisor'/>
Nov 11 01:34:10 user nova-compute[75215]:   </cpu>
Nov 11 01:34:10 user nova-compute[75215]:   <clock offset='utc'>
Nov 11 01:34:10 user nova-compute[75215]:     <timer name='pit' tickpolicy='delay'/>
Nov 11 01:34:10 user nova-compute[75215]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 11 01:34:10 user nova-compute[75215]:     <timer name='hpet' present='no'/>
Nov 11 01:34:10 user nova-compute[75215]:   </clock>
Nov 11 01:34:10 user nova-compute[75215]:   <on_poweroff>destroy</on_poweroff>
Nov 11 01:34:10 user nova-compute[75215]:   <on_reboot>restart</on_reboot>
Nov 11 01:34:10 user nova-compute[75215]:   <on_crash>destroy</on_crash>
Nov 11 01:34:10 user nova-compute[75215]:   <devices>
Nov 11 01:34:10 user nova-compute[75215]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 01:34:10 user nova-compute[75215]:     <disk type='file' device='disk'>
Nov 11 01:34:10 user nova-compute[75215]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 11 01:34:10 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk' index='2'/>
Nov 11 01:34:10 user nova-compute[75215]:       <backingStore type='file' index='3'>
Nov 11 01:34:10 user nova-compute[75215]:         <format type='raw'/>
Nov 11 01:34:10 user nova-compute[75215]:         <source file='/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137'/>
Nov 11 01:34:10 user nova-compute[75215]:         <backingStore/>
Nov 11 01:34:10 user nova-compute[75215]:       </backingStore>
Nov 11 01:34:10 user nova-compute[75215]:       <target dev='vda' bus='virtio'/>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='virtio-disk0'/>
Nov 11 01:34:10 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </disk>
Nov 11 01:34:10 user nova-compute[75215]:     <disk type='file' device='cdrom'>
Nov 11 01:34:10 user nova-compute[75215]:       <driver name='qemu' type='raw' cache='none'/>
Nov 11 01:34:10 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.config' index='1'/>
Nov 11 01:34:10 user nova-compute[75215]:       <backingStore/>
Nov 11 01:34:10 user nova-compute[75215]:       <target dev='hda' bus='ide'/>
Nov 11 01:34:10 user nova-compute[75215]:       <readonly/>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='ide0-0-0'/>
Nov 11 01:34:10 user nova-compute[75215]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </disk>
Nov 11 01:34:10 user nova-compute[75215]:     <controller type='usb' index='0' model='none'>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='usb'/>
Nov 11 01:34:10 user nova-compute[75215]:     </controller>
Nov 11 01:34:10 user nova-compute[75215]:     <controller type='pci' index='0' model='pci-root'>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='pci.0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </controller>
Nov 11 01:34:10 user nova-compute[75215]:     <controller type='ide' index='0'>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='ide'/>
Nov 11 01:34:10 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 11 01:34:10 user nova-compute[75215]:     </controller>
Nov 11 01:34:10 user nova-compute[75215]:     <interface type='ethernet'>
Nov 11 01:34:10 user nova-compute[75215]:       <mac address='fa:16:3e:95:05:3a'/>
Nov 11 01:34:10 user nova-compute[75215]:       <target dev='tap997c39fb-7e'/>
Nov 11 01:34:10 user nova-compute[75215]:       <model type='virtio'/>
Nov 11 01:34:10 user nova-compute[75215]:       <mtu size='1442'/>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='net0'/>
Nov 11 01:34:10 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </interface>
Nov 11 01:34:10 user nova-compute[75215]:     <interface type='ethernet'>
Nov 11 01:34:10 user nova-compute[75215]:       <mac address='fa:16:3e:45:5a:32'/>
Nov 11 01:34:10 user nova-compute[75215]:       <target dev='tap76a7c0e1-39'/>
Nov 11 01:34:10 user nova-compute[75215]:       <model type='virtio'/>
Nov 11 01:34:10 user nova-compute[75215]:       <mtu size='1442'/>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='net1'/>
Nov 11 01:34:10 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </interface>
Nov 11 01:34:10 user nova-compute[75215]:     <serial type='pty'>
Nov 11 01:34:10 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 11 01:34:10 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log' append='off'/>
Nov 11 01:34:10 user nova-compute[75215]:       <target type='isa-serial' port='0'>
Nov 11 01:34:10 user nova-compute[75215]:         <model name='isa-serial'/>
Nov 11 01:34:10 user nova-compute[75215]:       </target>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='serial0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </serial>
Nov 11 01:34:10 user nova-compute[75215]:     <console type='pty' tty='/dev/pts/7'>
Nov 11 01:34:10 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 11 01:34:10 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log' append='off'/>
Nov 11 01:34:10 user nova-compute[75215]:       <target type='serial' port='0'/>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='serial0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </console>
Nov 11 01:34:10 user nova-compute[75215]:     <input type='mouse' bus='ps2'>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='input0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </input>
Nov 11 01:34:10 user nova-compute[75215]:     <input type='keyboard' bus='ps2'>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='input1'/>
Nov 11 01:34:10 user nova-compute[75215]:     </input>
Nov 11 01:34:10 user nova-compute[75215]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 11 01:34:10 user nova-compute[75215]:       <listen type='address' address='0.0.0.0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </graphics>
Nov 11 01:34:10 user nova-compute[75215]:     <audio id='1' type='none'/>
Nov 11 01:34:10 user nova-compute[75215]:     <video>
Nov 11 01:34:10 user nova-compute[75215]:       <model type='virtio' heads='1' primary='yes'/>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='video0'/>
Nov 11 01:34:10 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </video>
Nov 11 01:34:10 user nova-compute[75215]:     <memballoon model='virtio'>
Nov 11 01:34:10 user nova-compute[75215]:       <stats period='10'/>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='balloon0'/>
Nov 11 01:34:10 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </memballoon>
Nov 11 01:34:10 user nova-compute[75215]:     <rng model='virtio'>
Nov 11 01:34:10 user nova-compute[75215]:       <backend model='random'>/dev/urandom</backend>
Nov 11 01:34:10 user nova-compute[75215]:       <alias name='rng0'/>
Nov 11 01:34:10 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 11 01:34:10 user nova-compute[75215]:     </rng>
Nov 11 01:34:10 user nova-compute[75215]:   </devices>
Nov 11 01:34:10 user nova-compute[75215]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 11 01:34:10 user nova-compute[75215]:     <label>libvirt-c7c8d8f5-5e51-4e02-8001-ea843090f471</label>
Nov 11 01:34:10 user nova-compute[75215]:     <imagelabel>libvirt-c7c8d8f5-5e51-4e02-8001-ea843090f471</imagelabel>
Nov 11 01:34:10 user nova-compute[75215]:   </seclabel>
Nov 11 01:34:10 user nova-compute[75215]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 11 01:34:10 user nova-compute[75215]:     <label>+64055:+108</label>
Nov 11 01:34:10 user nova-compute[75215]:     <imagelabel>+64055:+108</imagelabel>
Nov 11 01:34:10 user nova-compute[75215]:   </seclabel>
Nov 11 01:34:10 user nova-compute[75215]: </domain>
Nov 11 01:34:10 user nova-compute[75215]:  {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 11 01:34:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Successfully detached device tap76a7c0e1-39 from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 from the persistent domain config.
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] (1/8): Attempting to detach device tap76a7c0e1-39 with device alias net1 from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] detach device xml: <interface type="ethernet">
Nov 11 01:34:10 user nova-compute[75215]:   <mac address="fa:16:3e:45:5a:32"/>
Nov 11 01:34:10 user nova-compute[75215]:   <model type="virtio"/>
Nov 11 01:34:10 user nova-compute[75215]:   <mtu size="1442"/>
Nov 11 01:34:10 user nova-compute[75215]:   <target dev="tap76a7c0e1-39"/>
Nov 11 01:34:10 user nova-compute[75215]: </interface>
Nov 11 01:34:10 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-f57e46b7-f538-481c-962f-cdf7f3e0cb4b req-81c990e5-d18b-4669-af4f-6e802648a252 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received event network-vif-unplugged-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f57e46b7-f538-481c-962f-cdf7f3e0cb4b req-81c990e5-d18b-4669-af4f-6e802648a252 service nova] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f57e46b7-f538-481c-962f-cdf7f3e0cb4b req-81c990e5-d18b-4669-af4f-6e802648a252 service nova] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f57e46b7-f538-481c-962f-cdf7f3e0cb4b req-81c990e5-d18b-4669-af4f-6e802648a252 service nova] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-f57e46b7-f538-481c-962f-cdf7f3e0cb4b req-81c990e5-d18b-4669-af4f-6e802648a252 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] No waiting events found dispatching network-vif-unplugged-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-f57e46b7-f538-481c-962f-cdf7f3e0cb4b req-81c990e5-d18b-4669-af4f-6e802648a252 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received event network-vif-unplugged-bdc930c6-56b8-46bb-8645-496286713b8c for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Start waiting for the detach event from libvirt for device tap76a7c0e1-39 with device alias net1 for instance c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c3aa0c9b-13fe-44be-942f-27c43040f824 req-9af3f809-36bf-42f1-8210-485cb6a8ed1b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-unplugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3aa0c9b-13fe-44be-942f-27c43040f824 req-9af3f809-36bf-42f1-8210-485cb6a8ed1b service nova] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3aa0c9b-13fe-44be-942f-27c43040f824 req-9af3f809-36bf-42f1-8210-485cb6a8ed1b service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3aa0c9b-13fe-44be-942f-27c43040f824 req-9af3f809-36bf-42f1-8210-485cb6a8ed1b service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-c3aa0c9b-13fe-44be-942f-27c43040f824 req-9af3f809-36bf-42f1-8210-485cb6a8ed1b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] No waiting events found dispatching network-vif-unplugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:10 user nova-compute[75215]: WARNING nova.compute.manager [req-c3aa0c9b-13fe-44be-942f-27c43040f824 req-9af3f809-36bf-42f1-8210-485cb6a8ed1b service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received unexpected event network-vif-unplugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 for instance with vm_state active and task_state None.
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Instance destroyed successfully.
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lazy-loading 'resources' on Instance uuid 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1897854606',display_name='tempest-AttachSCSIVolumeTestJSON-server-1897854606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1897854606',id=7,image_ref='60a0bb82-d06b-43ba-b339-863e1f786c86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnLSWiVwvihukaEBkR/Hbzs+ugegITSdge03YF0fgFj+mgXm95IHrdAPk4A4yx6H0Y1sm4Xnvo3OQQTGQEeUIH7iyB8L9WFJT9UfYy8bIlc1Ts2a8/MI5F19cdi4cz69A==',key_name='tempest-keypair-963031833',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dde2f8d401c74e5fae4f7e722c0ca498',ramdisk_id='',reservation_id='r-xqaueeaj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60a0bb82-d06b-43ba-b339-863e1f786c86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-62693113',owner_user_name='tempest-AttachSCSIVolumeTestJSON-62693113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='326e917356ad47e0bc1b9ae334398318',uuid=1a7404dd-181a-40d5-af0a-e6b2dd8e1958,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Converting VIF {"id": "bdc930c6-56b8-46bb-8645-496286713b8c", "address": "fa:16:3e:02:c7:65", "network": {"id": "eb6db38a-1cd1-4490-9b77-7ba5fcc82361", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-686232772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde2f8d401c74e5fae4f7e722c0ca498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc930c6-56", "ovs_interfaceid": "bdc930c6-56b8-46bb-8645-496286713b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=bdc930c6-56b8-46bb-8645-496286713b8c,network=Network(eb6db38a-1cd1-4490-9b77-7ba5fcc82361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc930c6-56') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG os_vif [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=bdc930c6-56b8-46bb-8645-496286713b8c,network=Network(eb6db38a-1cd1-4490-9b77-7ba5fcc82361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc930c6-56') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdc930c6-56, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f671b06-1a00-4545-ade4-2fc935cacc19) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:10 user nova-compute[75215]: INFO os_vif [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=bdc930c6-56b8-46bb-8645-496286713b8c,network=Network(eb6db38a-1cd1-4490-9b77-7ba5fcc82361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc930c6-56')
Nov 11 01:34:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Deleting instance files /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958_del
Nov 11 01:34:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Deletion of /opt/stack/data/nova/instances/1a7404dd-181a-40d5-af0a-e6b2dd8e1958_del complete
Nov 11 01:34:11 user nova-compute[75215]: INFO nova.compute.manager [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 11 01:34:11 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-18312c12-1bac-43f1-896f-17d8c7269146 req-dd8bb269-329e-45bb-96d6-f411e8a28190 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received event network-vif-deleted-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:12 user nova-compute[75215]: INFO nova.compute.manager [req-18312c12-1bac-43f1-896f-17d8c7269146 req-dd8bb269-329e-45bb-96d6-f411e8a28190 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Neutron deleted interface bdc930c6-56b8-46bb-8645-496286713b8c; detaching it from the instance and deleting it from the info cache
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-18312c12-1bac-43f1-896f-17d8c7269146 req-dd8bb269-329e-45bb-96d6-f411e8a28190 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:34:12 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Took 0.97 seconds to deallocate network for instance.
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-18312c12-1bac-43f1-896f-17d8c7269146 req-dd8bb269-329e-45bb-96d6-f411e8a28190 service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Detach interface failed, port_id=bdc930c6-56b8-46bb-8645-496286713b8c, reason: Instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdk (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-8de35246-069f-4836-b1fe-a92973801c5b req-7074068e-589c-4c09-963c-a990b3d7f22f service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received event network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8de35246-069f-4836-b1fe-a92973801c5b req-7074068e-589c-4c09-963c-a990b3d7f22f service nova] Acquiring lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8de35246-069f-4836-b1fe-a92973801c5b req-7074068e-589c-4c09-963c-a990b3d7f22f service nova] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8de35246-069f-4836-b1fe-a92973801c5b req-7074068e-589c-4c09-963c-a990b3d7f22f service nova] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-8de35246-069f-4836-b1fe-a92973801c5b req-7074068e-589c-4c09-963c-a990b3d7f22f service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] No waiting events found dispatching network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:12 user nova-compute[75215]: WARNING nova.compute.manager [req-8de35246-069f-4836-b1fe-a92973801c5b req-7074068e-589c-4c09-963c-a990b3d7f22f service nova] [instance: 1a7404dd-181a-40d5-af0a-e6b2dd8e1958] Received unexpected event network-vif-plugged-bdc930c6-56b8-46bb-8645-496286713b8c for instance with vm_state deleted and task_state None.
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-2e1bc29a-fd5d-47bd-a817-4f6af2f99863 req-70b39cd6-c706-40fa-8e0a-18981c497bfe service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2e1bc29a-fd5d-47bd-a817-4f6af2f99863 req-70b39cd6-c706-40fa-8e0a-18981c497bfe service nova] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2e1bc29a-fd5d-47bd-a817-4f6af2f99863 req-70b39cd6-c706-40fa-8e0a-18981c497bfe service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2e1bc29a-fd5d-47bd-a817-4f6af2f99863 req-70b39cd6-c706-40fa-8e0a-18981c497bfe service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-2e1bc29a-fd5d-47bd-a817-4f6af2f99863 req-70b39cd6-c706-40fa-8e0a-18981c497bfe service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] No waiting events found dispatching network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:12 user nova-compute[75215]: WARNING nova.compute.manager [req-2e1bc29a-fd5d-47bd-a817-4f6af2f99863 req-70b39cd6-c706-40fa-8e0a-18981c497bfe service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received unexpected event network-vif-plugged-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 for instance with vm_state active and task_state None.
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:12 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Deleted allocations for instance 1a7404dd-181a-40d5-af0a-e6b2dd8e1958
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e74e8687-6b71-489c-bc9a-6672c7158846 tempest-AttachSCSIVolumeTestJSON-62693113 tempest-AttachSCSIVolumeTestJSON-62693113-project-member] Lock "1a7404dd-181a-40d5-af0a-e6b2dd8e1958" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.995s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:34:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:34:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7873MB free_disk=25.51516342163086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c7c8d8f5-5e51-4e02-8001-ea843090f471 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a0456c90-8b61-44aa-9484-08d9a481f8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b7244d96-4c01-4a87-b76c-d76ba83e3879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:34:15 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:34:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:34:16 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:34:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:34:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.volume.cinder [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Update attachment failed for attachment db5ac5ea-97ce-4c7b-904d-b45fc633ced1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5e71c27f-4ce0-48b1-bd2c-8cab0b364cda) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5e71c27f-4ce0-48b1-bd2c-8cab0b364cda)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Failed to attach 453fb811-8171-4f61-abfc-6161f569140b at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5e71c27f-4ce0-48b1-bd2c-8cab0b364cda)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Traceback (most recent call last):
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     ret_val = method(obj, context, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     self._do_attach(context, instance, volume, volume_api,
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     self._volume_attach(context, volume, connector, instance,
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     connection_info = volume_api.attachment_update(
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     res = method(self, ctx, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     with excutils.save_and_reraise_exception():
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     self.force_reraise()
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     raise self.value
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     context, '3.44', skip_version_check=True).attachments.update(
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     return method.func(obj, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     resp = self._update('/attachments/%s' % id, body)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     return self._cs_request(url, 'PUT', **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     return self.request(url, method, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5]     raise exceptions.from_response(resp, body)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5e71c27f-4ce0-48b1-bd2c-8cab0b364cda)
Nov 11 01:34:17 user nova-compute[75215]: ERROR nova.compute.manager [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] 
Nov 11 01:34:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.838s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-59a5dc4e-c708-4569-9f92-132148e72565 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5e71c27f-4ce0-48b1-bd2c-8cab0b364cda)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5e71c27f-4ce0-48b1-bd2c-8cab0b364cda)
Nov 11 01:34:17 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 11 01:34:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:34:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:34:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:34:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updating instance_info_cache with network_info: [{"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:34:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:34:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:34:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:34:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:34:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Waiting for libvirt event about the detach of device tap76a7c0e1-39 with device alias net1 from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 is timed out.
Nov 11 01:34:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 11 01:34:30 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 11 01:34:30 user nova-compute[75215]:   <uuid>c7c8d8f5-5e51-4e02-8001-ea843090f471</uuid>
Nov 11 01:34:30 user nova-compute[75215]:   <metadata>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:34:30 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-1881855644</nova:name>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:creationTime>2023-11-11 01:31:55</nova:creationTime>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 11 01:34:30 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 11 01:34:30 user nova-compute[75215]:   </nova:flavor>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:owner>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:user uuid="6269f798c52c45ee9ca9aa29a4487798">tempest-TaggedAttachmentsTest-1511763889-project-member</nova:user>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:project uuid="e369e597968643269939d15256b6ae97">tempest-TaggedAttachmentsTest-1511763889</nova:project>
Nov 11 01:34:30 user nova-compute[75215]:   </nova:owner>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:ports>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:port uuid="997c39fb-7e21-4af1-acf2-e0e70157b02d">
Nov 11 01:34:30 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:34:30 user nova-compute[75215]:     </nova:port>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:port uuid="76a7c0e1-3978-4f0a-825a-bf6bd5f36095">
Nov 11 01:34:30 user nova-compute[75215]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Nov 11 01:34:30 user nova-compute[75215]:     </nova:port>
Nov 11 01:34:30 user nova-compute[75215]:   </nova:ports>
Nov 11 01:34:30 user nova-compute[75215]: </nova:instance>
Nov 11 01:34:30 user nova-compute[75215]:   </metadata>
Nov 11 01:34:30 user nova-compute[75215]:   <memory unit='KiB'>524288</memory>
Nov 11 01:34:30 user nova-compute[75215]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 11 01:34:30 user nova-compute[75215]:   <vcpu placement='static'>1</vcpu>
Nov 11 01:34:30 user nova-compute[75215]:   <resource>
Nov 11 01:34:30 user nova-compute[75215]:     <partition>/machine</partition>
Nov 11 01:34:30 user nova-compute[75215]:   </resource>
Nov 11 01:34:30 user nova-compute[75215]:   <sysinfo type='smbios'>
Nov 11 01:34:30 user nova-compute[75215]:     <system>
Nov 11 01:34:30 user nova-compute[75215]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 11 01:34:30 user nova-compute[75215]:       <entry name='product'>OpenStack Nova</entry>
Nov 11 01:34:30 user nova-compute[75215]:       <entry name='version'>0.0.0</entry>
Nov 11 01:34:30 user nova-compute[75215]:       <entry name='serial'>c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:34:30 user nova-compute[75215]:       <entry name='uuid'>c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:34:30 user nova-compute[75215]:       <entry name='family'>Virtual Machine</entry>
Nov 11 01:34:30 user nova-compute[75215]:     </system>
Nov 11 01:34:30 user nova-compute[75215]:   </sysinfo>
Nov 11 01:34:30 user nova-compute[75215]:   <os>
Nov 11 01:34:30 user nova-compute[75215]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 11 01:34:30 user nova-compute[75215]:     <boot dev='hd'/>
Nov 11 01:34:30 user nova-compute[75215]:     <smbios mode='sysinfo'/>
Nov 11 01:34:30 user nova-compute[75215]:   </os>
Nov 11 01:34:30 user nova-compute[75215]:   <features>
Nov 11 01:34:30 user nova-compute[75215]:     <acpi/>
Nov 11 01:34:30 user nova-compute[75215]:     <apic/>
Nov 11 01:34:30 user nova-compute[75215]:     <vmcoreinfo state='on'/>
Nov 11 01:34:30 user nova-compute[75215]:   </features>
Nov 11 01:34:30 user nova-compute[75215]:   <cpu mode='custom' match='exact' check='full'>
Nov 11 01:34:30 user nova-compute[75215]:     <model fallback='forbid'>Nehalem</model>
Nov 11 01:34:30 user nova-compute[75215]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 11 01:34:30 user nova-compute[75215]:     <feature policy='require' name='vme'/>
Nov 11 01:34:30 user nova-compute[75215]:     <feature policy='require' name='x2apic'/>
Nov 11 01:34:30 user nova-compute[75215]:     <feature policy='require' name='hypervisor'/>
Nov 11 01:34:30 user nova-compute[75215]:   </cpu>
Nov 11 01:34:30 user nova-compute[75215]:   <clock offset='utc'>
Nov 11 01:34:30 user nova-compute[75215]:     <timer name='pit' tickpolicy='delay'/>
Nov 11 01:34:30 user nova-compute[75215]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 11 01:34:30 user nova-compute[75215]:     <timer name='hpet' present='no'/>
Nov 11 01:34:30 user nova-compute[75215]:   </clock>
Nov 11 01:34:30 user nova-compute[75215]:   <on_poweroff>destroy</on_poweroff>
Nov 11 01:34:30 user nova-compute[75215]:   <on_reboot>restart</on_reboot>
Nov 11 01:34:30 user nova-compute[75215]:   <on_crash>destroy</on_crash>
Nov 11 01:34:30 user nova-compute[75215]:   <devices>
Nov 11 01:34:30 user nova-compute[75215]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 01:34:30 user nova-compute[75215]:     <disk type='file' device='disk'>
Nov 11 01:34:30 user nova-compute[75215]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 11 01:34:30 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk' index='2'/>
Nov 11 01:34:30 user nova-compute[75215]:       <backingStore type='file' index='3'>
Nov 11 01:34:30 user nova-compute[75215]:         <format type='raw'/>
Nov 11 01:34:30 user nova-compute[75215]:         <source file='/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137'/>
Nov 11 01:34:30 user nova-compute[75215]:         <backingStore/>
Nov 11 01:34:30 user nova-compute[75215]:       </backingStore>
Nov 11 01:34:30 user nova-compute[75215]:       <target dev='vda' bus='virtio'/>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='virtio-disk0'/>
Nov 11 01:34:30 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </disk>
Nov 11 01:34:30 user nova-compute[75215]:     <disk type='file' device='cdrom'>
Nov 11 01:34:30 user nova-compute[75215]:       <driver name='qemu' type='raw' cache='none'/>
Nov 11 01:34:30 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.config' index='1'/>
Nov 11 01:34:30 user nova-compute[75215]:       <backingStore/>
Nov 11 01:34:30 user nova-compute[75215]:       <target dev='hda' bus='ide'/>
Nov 11 01:34:30 user nova-compute[75215]:       <readonly/>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='ide0-0-0'/>
Nov 11 01:34:30 user nova-compute[75215]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </disk>
Nov 11 01:34:30 user nova-compute[75215]:     <controller type='usb' index='0' model='none'>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='usb'/>
Nov 11 01:34:30 user nova-compute[75215]:     </controller>
Nov 11 01:34:30 user nova-compute[75215]:     <controller type='pci' index='0' model='pci-root'>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='pci.0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </controller>
Nov 11 01:34:30 user nova-compute[75215]:     <controller type='ide' index='0'>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='ide'/>
Nov 11 01:34:30 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 11 01:34:30 user nova-compute[75215]:     </controller>
Nov 11 01:34:30 user nova-compute[75215]:     <interface type='ethernet'>
Nov 11 01:34:30 user nova-compute[75215]:       <mac address='fa:16:3e:95:05:3a'/>
Nov 11 01:34:30 user nova-compute[75215]:       <target dev='tap997c39fb-7e'/>
Nov 11 01:34:30 user nova-compute[75215]:       <model type='virtio'/>
Nov 11 01:34:30 user nova-compute[75215]:       <mtu size='1442'/>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='net0'/>
Nov 11 01:34:30 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </interface>
Nov 11 01:34:30 user nova-compute[75215]:     <serial type='pty'>
Nov 11 01:34:30 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 11 01:34:30 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log' append='off'/>
Nov 11 01:34:30 user nova-compute[75215]:       <target type='isa-serial' port='0'>
Nov 11 01:34:30 user nova-compute[75215]:         <model name='isa-serial'/>
Nov 11 01:34:30 user nova-compute[75215]:       </target>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='serial0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </serial>
Nov 11 01:34:30 user nova-compute[75215]:     <console type='pty' tty='/dev/pts/7'>
Nov 11 01:34:30 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 11 01:34:30 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log' append='off'/>
Nov 11 01:34:30 user nova-compute[75215]:       <target type='serial' port='0'/>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='serial0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </console>
Nov 11 01:34:30 user nova-compute[75215]:     <input type='mouse' bus='ps2'>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='input0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </input>
Nov 11 01:34:30 user nova-compute[75215]:     <input type='keyboard' bus='ps2'>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='input1'/>
Nov 11 01:34:30 user nova-compute[75215]:     </input>
Nov 11 01:34:30 user nova-compute[75215]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 11 01:34:30 user nova-compute[75215]:       <listen type='address' address='0.0.0.0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </graphics>
Nov 11 01:34:30 user nova-compute[75215]:     <audio id='1' type='none'/>
Nov 11 01:34:30 user nova-compute[75215]:     <video>
Nov 11 01:34:30 user nova-compute[75215]:       <model type='virtio' heads='1' primary='yes'/>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='video0'/>
Nov 11 01:34:30 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </video>
Nov 11 01:34:30 user nova-compute[75215]:     <memballoon model='virtio'>
Nov 11 01:34:30 user nova-compute[75215]:       <stats period='10'/>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='balloon0'/>
Nov 11 01:34:30 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </memballoon>
Nov 11 01:34:30 user nova-compute[75215]:     <rng model='virtio'>
Nov 11 01:34:30 user nova-compute[75215]:       <backend model='random'>/dev/urandom</backend>
Nov 11 01:34:30 user nova-compute[75215]:       <alias name='rng0'/>
Nov 11 01:34:30 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 11 01:34:30 user nova-compute[75215]:     </rng>
Nov 11 01:34:30 user nova-compute[75215]:   </devices>
Nov 11 01:34:30 user nova-compute[75215]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 11 01:34:30 user nova-compute[75215]:     <label>libvirt-c7c8d8f5-5e51-4e02-8001-ea843090f471</label>
Nov 11 01:34:30 user nova-compute[75215]:     <imagelabel>libvirt-c7c8d8f5-5e51-4e02-8001-ea843090f471</imagelabel>
Nov 11 01:34:30 user nova-compute[75215]:   </seclabel>
Nov 11 01:34:30 user nova-compute[75215]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 11 01:34:30 user nova-compute[75215]:     <label>+64055:+108</label>
Nov 11 01:34:30 user nova-compute[75215]:     <imagelabel>+64055:+108</imagelabel>
Nov 11 01:34:30 user nova-compute[75215]:   </seclabel>
Nov 11 01:34:30 user nova-compute[75215]: </domain>
Nov 11 01:34:30 user nova-compute[75215]:  {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 11 01:34:30 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Successfully detached device tap76a7c0e1-39 from instance c7c8d8f5-5e51-4e02-8001-ea843090f471 from the live domain config.
Nov 11 01:34:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converting VIF {"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG os_vif [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76a7c0e1-39, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc451e7a-4ac4-419b-8b7c-d85e9e198624) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:30 user nova-compute[75215]: INFO os_vif [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39')
Nov 11 01:34:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:34:30 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-1881855644</nova:name>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:creationTime>2023-11-11 01:34:30</nova:creationTime>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 11 01:34:30 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 11 01:34:30 user nova-compute[75215]:   </nova:flavor>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:owner>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:user uuid="6269f798c52c45ee9ca9aa29a4487798">tempest-TaggedAttachmentsTest-1511763889-project-member</nova:user>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:project uuid="e369e597968643269939d15256b6ae97">tempest-TaggedAttachmentsTest-1511763889</nova:project>
Nov 11 01:34:30 user nova-compute[75215]:   </nova:owner>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:34:30 user nova-compute[75215]:   <nova:ports>
Nov 11 01:34:30 user nova-compute[75215]:     <nova:port uuid="997c39fb-7e21-4af1-acf2-e0e70157b02d">
Nov 11 01:34:30 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:34:30 user nova-compute[75215]:     </nova:port>
Nov 11 01:34:30 user nova-compute[75215]:   </nova:ports>
Nov 11 01:34:30 user nova-compute[75215]: </nova:instance>
Nov 11 01:34:30 user nova-compute[75215]:  {{(pid=75215) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-deleted-76a7c0e1-3978-4f0a-825a-bf6bd5f36095 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:31 user nova-compute[75215]: INFO nova.compute.manager [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Neutron deleted interface 76a7c0e1-3978-4f0a-825a-bf6bd5f36095; detaching it from the instance and deleting it from the info cache
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating instance_info_cache with network_info: [{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquired lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.objects.instance [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Lazy-loading 'system_metadata' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.objects.instance [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Lazy-loading 'flavor' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.objects.base [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Object Instance<c7c8d8f5-5e51-4e02-8001-ea843090f471> lazy-loaded attributes: system_metadata,flavor {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Converting VIF {"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 11 01:34:31 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 11 01:34:31 user nova-compute[75215]:   <uuid>c7c8d8f5-5e51-4e02-8001-ea843090f471</uuid>
Nov 11 01:34:31 user nova-compute[75215]:   <metadata>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:34:31 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-1881855644</nova:name>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:creationTime>2023-11-11 01:34:30</nova:creationTime>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 11 01:34:31 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:flavor>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:owner>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:user uuid="6269f798c52c45ee9ca9aa29a4487798">tempest-TaggedAttachmentsTest-1511763889-project-member</nova:user>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:project uuid="e369e597968643269939d15256b6ae97">tempest-TaggedAttachmentsTest-1511763889</nova:project>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:owner>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:ports>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:port uuid="997c39fb-7e21-4af1-acf2-e0e70157b02d">
Nov 11 01:34:31 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:34:31 user nova-compute[75215]:     </nova:port>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:ports>
Nov 11 01:34:31 user nova-compute[75215]: </nova:instance>
Nov 11 01:34:31 user nova-compute[75215]:   </metadata>
Nov 11 01:34:31 user nova-compute[75215]:   <memory unit='KiB'>524288</memory>
Nov 11 01:34:31 user nova-compute[75215]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 11 01:34:31 user nova-compute[75215]:   <vcpu placement='static'>1</vcpu>
Nov 11 01:34:31 user nova-compute[75215]:   <resource>
Nov 11 01:34:31 user nova-compute[75215]:     <partition>/machine</partition>
Nov 11 01:34:31 user nova-compute[75215]:   </resource>
Nov 11 01:34:31 user nova-compute[75215]:   <sysinfo type='smbios'>
Nov 11 01:34:31 user nova-compute[75215]:     <system>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='product'>OpenStack Nova</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='version'>0.0.0</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='serial'>c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='uuid'>c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='family'>Virtual Machine</entry>
Nov 11 01:34:31 user nova-compute[75215]:     </system>
Nov 11 01:34:31 user nova-compute[75215]:   </sysinfo>
Nov 11 01:34:31 user nova-compute[75215]:   <os>
Nov 11 01:34:31 user nova-compute[75215]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 11 01:34:31 user nova-compute[75215]:     <boot dev='hd'/>
Nov 11 01:34:31 user nova-compute[75215]:     <smbios mode='sysinfo'/>
Nov 11 01:34:31 user nova-compute[75215]:   </os>
Nov 11 01:34:31 user nova-compute[75215]:   <features>
Nov 11 01:34:31 user nova-compute[75215]:     <acpi/>
Nov 11 01:34:31 user nova-compute[75215]:     <apic/>
Nov 11 01:34:31 user nova-compute[75215]:     <vmcoreinfo state='on'/>
Nov 11 01:34:31 user nova-compute[75215]:   </features>
Nov 11 01:34:31 user nova-compute[75215]:   <cpu mode='custom' match='exact' check='full'>
Nov 11 01:34:31 user nova-compute[75215]:     <model fallback='forbid'>Nehalem</model>
Nov 11 01:34:31 user nova-compute[75215]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 11 01:34:31 user nova-compute[75215]:     <feature policy='require' name='vme'/>
Nov 11 01:34:31 user nova-compute[75215]:     <feature policy='require' name='x2apic'/>
Nov 11 01:34:31 user nova-compute[75215]:     <feature policy='require' name='hypervisor'/>
Nov 11 01:34:31 user nova-compute[75215]:   </cpu>
Nov 11 01:34:31 user nova-compute[75215]:   <clock offset='utc'>
Nov 11 01:34:31 user nova-compute[75215]:     <timer name='pit' tickpolicy='delay'/>
Nov 11 01:34:31 user nova-compute[75215]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 11 01:34:31 user nova-compute[75215]:     <timer name='hpet' present='no'/>
Nov 11 01:34:31 user nova-compute[75215]:   </clock>
Nov 11 01:34:31 user nova-compute[75215]:   <on_poweroff>destroy</on_poweroff>
Nov 11 01:34:31 user nova-compute[75215]:   <on_reboot>restart</on_reboot>
Nov 11 01:34:31 user nova-compute[75215]:   <on_crash>destroy</on_crash>
Nov 11 01:34:31 user nova-compute[75215]:   <devices>
Nov 11 01:34:31 user nova-compute[75215]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 01:34:31 user nova-compute[75215]:     <disk type='file' device='disk'>
Nov 11 01:34:31 user nova-compute[75215]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 11 01:34:31 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk' index='2'/>
Nov 11 01:34:31 user nova-compute[75215]:       <backingStore type='file' index='3'>
Nov 11 01:34:31 user nova-compute[75215]:         <format type='raw'/>
Nov 11 01:34:31 user nova-compute[75215]:         <source file='/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137'/>
Nov 11 01:34:31 user nova-compute[75215]:         <backingStore/>
Nov 11 01:34:31 user nova-compute[75215]:       </backingStore>
Nov 11 01:34:31 user nova-compute[75215]:       <target dev='vda' bus='virtio'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='virtio-disk0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </disk>
Nov 11 01:34:31 user nova-compute[75215]:     <disk type='file' device='cdrom'>
Nov 11 01:34:31 user nova-compute[75215]:       <driver name='qemu' type='raw' cache='none'/>
Nov 11 01:34:31 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.config' index='1'/>
Nov 11 01:34:31 user nova-compute[75215]:       <backingStore/>
Nov 11 01:34:31 user nova-compute[75215]:       <target dev='hda' bus='ide'/>
Nov 11 01:34:31 user nova-compute[75215]:       <readonly/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='ide0-0-0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </disk>
Nov 11 01:34:31 user nova-compute[75215]:     <controller type='usb' index='0' model='none'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='usb'/>
Nov 11 01:34:31 user nova-compute[75215]:     </controller>
Nov 11 01:34:31 user nova-compute[75215]:     <controller type='pci' index='0' model='pci-root'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='pci.0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </controller>
Nov 11 01:34:31 user nova-compute[75215]:     <controller type='ide' index='0'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='ide'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 11 01:34:31 user nova-compute[75215]:     </controller>
Nov 11 01:34:31 user nova-compute[75215]:     <interface type='ethernet'>
Nov 11 01:34:31 user nova-compute[75215]:       <mac address='fa:16:3e:95:05:3a'/>
Nov 11 01:34:31 user nova-compute[75215]:       <target dev='tap997c39fb-7e'/>
Nov 11 01:34:31 user nova-compute[75215]:       <model type='virtio'/>
Nov 11 01:34:31 user nova-compute[75215]:       <mtu size='1442'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='net0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </interface>
Nov 11 01:34:31 user nova-compute[75215]:     <serial type='pty'>
Nov 11 01:34:31 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 11 01:34:31 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log' append='off'/>
Nov 11 01:34:31 user nova-compute[75215]:       <target type='isa-serial' port='0'>
Nov 11 01:34:31 user nova-compute[75215]:         <model name='isa-serial'/>
Nov 11 01:34:31 user nova-compute[75215]:       </target>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='serial0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </serial>
Nov 11 01:34:31 user nova-compute[75215]:     <console type='pty' tty='/dev/pts/7'>
Nov 11 01:34:31 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 11 01:34:31 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log' append='off'/>
Nov 11 01:34:31 user nova-compute[75215]:       <target type='serial' port='0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='serial0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </console>
Nov 11 01:34:31 user nova-compute[75215]:     <input type='mouse' bus='ps2'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='input0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </input>
Nov 11 01:34:31 user nova-compute[75215]:     <input type='keyboard' bus='ps2'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='input1'/>
Nov 11 01:34:31 user nova-compute[75215]:     </input>
Nov 11 01:34:31 user nova-compute[75215]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 11 01:34:31 user nova-compute[75215]:       <listen type='address' address='0.0.0.0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </graphics>
Nov 11 01:34:31 user nova-compute[75215]:     <audio id='1' type='none'/>
Nov 11 01:34:31 user nova-compute[75215]:     <video>
Nov 11 01:34:31 user nova-compute[75215]:       <model type='virtio' heads='1' primary='yes'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='video0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </video>
Nov 11 01:34:31 user nova-compute[75215]:     <memballoon model='virtio'>
Nov 11 01:34:31 user nova-compute[75215]:       <stats period='10'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='balloon0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </memballoon>
Nov 11 01:34:31 user nova-compute[75215]:     <rng model='virtio'>
Nov 11 01:34:31 user nova-compute[75215]:       <backend model='random'>/dev/urandom</backend>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='rng0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </rng>
Nov 11 01:34:31 user nova-compute[75215]:   </devices>
Nov 11 01:34:31 user nova-compute[75215]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 11 01:34:31 user nova-compute[75215]:     <label>libvirt-c7c8d8f5-5e51-4e02-8001-ea843090f471</label>
Nov 11 01:34:31 user nova-compute[75215]:     <imagelabel>libvirt-c7c8d8f5-5e51-4e02-8001-ea843090f471</imagelabel>
Nov 11 01:34:31 user nova-compute[75215]:   </seclabel>
Nov 11 01:34:31 user nova-compute[75215]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 11 01:34:31 user nova-compute[75215]:     <label>+64055:+108</label>
Nov 11 01:34:31 user nova-compute[75215]:     <imagelabel>+64055:+108</imagelabel>
Nov 11 01:34:31 user nova-compute[75215]:   </seclabel>
Nov 11 01:34:31 user nova-compute[75215]: </domain>
Nov 11 01:34:31 user nova-compute[75215]:  {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface> {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:45:5a:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap76a7c0e1-39"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 11 01:34:31 user nova-compute[75215]:   <name>instance-00000008</name>
Nov 11 01:34:31 user nova-compute[75215]:   <uuid>c7c8d8f5-5e51-4e02-8001-ea843090f471</uuid>
Nov 11 01:34:31 user nova-compute[75215]:   <metadata>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:34:31 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-1881855644</nova:name>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:creationTime>2023-11-11 01:34:30</nova:creationTime>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 11 01:34:31 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:flavor>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:owner>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:user uuid="6269f798c52c45ee9ca9aa29a4487798">tempest-TaggedAttachmentsTest-1511763889-project-member</nova:user>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:project uuid="e369e597968643269939d15256b6ae97">tempest-TaggedAttachmentsTest-1511763889</nova:project>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:owner>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:ports>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:port uuid="997c39fb-7e21-4af1-acf2-e0e70157b02d">
Nov 11 01:34:31 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:34:31 user nova-compute[75215]:     </nova:port>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:ports>
Nov 11 01:34:31 user nova-compute[75215]: </nova:instance>
Nov 11 01:34:31 user nova-compute[75215]:   </metadata>
Nov 11 01:34:31 user nova-compute[75215]:   <memory unit='KiB'>524288</memory>
Nov 11 01:34:31 user nova-compute[75215]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 11 01:34:31 user nova-compute[75215]:   <vcpu placement='static'>1</vcpu>
Nov 11 01:34:31 user nova-compute[75215]:   <resource>
Nov 11 01:34:31 user nova-compute[75215]:     <partition>/machine</partition>
Nov 11 01:34:31 user nova-compute[75215]:   </resource>
Nov 11 01:34:31 user nova-compute[75215]:   <sysinfo type='smbios'>
Nov 11 01:34:31 user nova-compute[75215]:     <system>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='product'>OpenStack Nova</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='version'>0.0.0</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='serial'>c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='uuid'>c7c8d8f5-5e51-4e02-8001-ea843090f471</entry>
Nov 11 01:34:31 user nova-compute[75215]:       <entry name='family'>Virtual Machine</entry>
Nov 11 01:34:31 user nova-compute[75215]:     </system>
Nov 11 01:34:31 user nova-compute[75215]:   </sysinfo>
Nov 11 01:34:31 user nova-compute[75215]:   <os>
Nov 11 01:34:31 user nova-compute[75215]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 11 01:34:31 user nova-compute[75215]:     <boot dev='hd'/>
Nov 11 01:34:31 user nova-compute[75215]:     <smbios mode='sysinfo'/>
Nov 11 01:34:31 user nova-compute[75215]:   </os>
Nov 11 01:34:31 user nova-compute[75215]:   <features>
Nov 11 01:34:31 user nova-compute[75215]:     <acpi/>
Nov 11 01:34:31 user nova-compute[75215]:     <apic/>
Nov 11 01:34:31 user nova-compute[75215]:     <vmcoreinfo state='on'/>
Nov 11 01:34:31 user nova-compute[75215]:   </features>
Nov 11 01:34:31 user nova-compute[75215]:   <cpu mode='custom' match='exact' check='full'>
Nov 11 01:34:31 user nova-compute[75215]:     <model fallback='forbid'>Nehalem</model>
Nov 11 01:34:31 user nova-compute[75215]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 11 01:34:31 user nova-compute[75215]:     <feature policy='require' name='vme'/>
Nov 11 01:34:31 user nova-compute[75215]:     <feature policy='require' name='x2apic'/>
Nov 11 01:34:31 user nova-compute[75215]:     <feature policy='require' name='hypervisor'/>
Nov 11 01:34:31 user nova-compute[75215]:   </cpu>
Nov 11 01:34:31 user nova-compute[75215]:   <clock offset='utc'>
Nov 11 01:34:31 user nova-compute[75215]:     <timer name='pit' tickpolicy='delay'/>
Nov 11 01:34:31 user nova-compute[75215]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 11 01:34:31 user nova-compute[75215]:     <timer name='hpet' present='no'/>
Nov 11 01:34:31 user nova-compute[75215]:   </clock>
Nov 11 01:34:31 user nova-compute[75215]:   <on_poweroff>destroy</on_poweroff>
Nov 11 01:34:31 user nova-compute[75215]:   <on_reboot>restart</on_reboot>
Nov 11 01:34:31 user nova-compute[75215]:   <on_crash>destroy</on_crash>
Nov 11 01:34:31 user nova-compute[75215]:   <devices>
Nov 11 01:34:31 user nova-compute[75215]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 01:34:31 user nova-compute[75215]:     <disk type='file' device='disk'>
Nov 11 01:34:31 user nova-compute[75215]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 11 01:34:31 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk' index='2'/>
Nov 11 01:34:31 user nova-compute[75215]:       <backingStore type='file' index='3'>
Nov 11 01:34:31 user nova-compute[75215]:         <format type='raw'/>
Nov 11 01:34:31 user nova-compute[75215]:         <source file='/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137'/>
Nov 11 01:34:31 user nova-compute[75215]:         <backingStore/>
Nov 11 01:34:31 user nova-compute[75215]:       </backingStore>
Nov 11 01:34:31 user nova-compute[75215]:       <target dev='vda' bus='virtio'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='virtio-disk0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </disk>
Nov 11 01:34:31 user nova-compute[75215]:     <disk type='file' device='cdrom'>
Nov 11 01:34:31 user nova-compute[75215]:       <driver name='qemu' type='raw' cache='none'/>
Nov 11 01:34:31 user nova-compute[75215]:       <source file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/disk.config' index='1'/>
Nov 11 01:34:31 user nova-compute[75215]:       <backingStore/>
Nov 11 01:34:31 user nova-compute[75215]:       <target dev='hda' bus='ide'/>
Nov 11 01:34:31 user nova-compute[75215]:       <readonly/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='ide0-0-0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </disk>
Nov 11 01:34:31 user nova-compute[75215]:     <controller type='usb' index='0' model='none'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='usb'/>
Nov 11 01:34:31 user nova-compute[75215]:     </controller>
Nov 11 01:34:31 user nova-compute[75215]:     <controller type='pci' index='0' model='pci-root'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='pci.0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </controller>
Nov 11 01:34:31 user nova-compute[75215]:     <controller type='ide' index='0'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='ide'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 11 01:34:31 user nova-compute[75215]:     </controller>
Nov 11 01:34:31 user nova-compute[75215]:     <interface type='ethernet'>
Nov 11 01:34:31 user nova-compute[75215]:       <mac address='fa:16:3e:95:05:3a'/>
Nov 11 01:34:31 user nova-compute[75215]:       <target dev='tap997c39fb-7e'/>
Nov 11 01:34:31 user nova-compute[75215]:       <model type='virtio'/>
Nov 11 01:34:31 user nova-compute[75215]:       <mtu size='1442'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='net0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </interface>
Nov 11 01:34:31 user nova-compute[75215]:     <serial type='pty'>
Nov 11 01:34:31 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 11 01:34:31 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log' append='off'/>
Nov 11 01:34:31 user nova-compute[75215]:       <target type='isa-serial' port='0'>
Nov 11 01:34:31 user nova-compute[75215]:         <model name='isa-serial'/>
Nov 11 01:34:31 user nova-compute[75215]:       </target>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='serial0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </serial>
Nov 11 01:34:31 user nova-compute[75215]:     <console type='pty' tty='/dev/pts/7'>
Nov 11 01:34:31 user nova-compute[75215]:       <source path='/dev/pts/7'/>
Nov 11 01:34:31 user nova-compute[75215]:       <log file='/opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471/console.log' append='off'/>
Nov 11 01:34:31 user nova-compute[75215]:       <target type='serial' port='0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='serial0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </console>
Nov 11 01:34:31 user nova-compute[75215]:     <input type='mouse' bus='ps2'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='input0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </input>
Nov 11 01:34:31 user nova-compute[75215]:     <input type='keyboard' bus='ps2'>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='input1'/>
Nov 11 01:34:31 user nova-compute[75215]:     </input>
Nov 11 01:34:31 user nova-compute[75215]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 11 01:34:31 user nova-compute[75215]:       <listen type='address' address='0.0.0.0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </graphics>
Nov 11 01:34:31 user nova-compute[75215]:     <audio id='1' type='none'/>
Nov 11 01:34:31 user nova-compute[75215]:     <video>
Nov 11 01:34:31 user nova-compute[75215]:       <model type='virtio' heads='1' primary='yes'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='video0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </video>
Nov 11 01:34:31 user nova-compute[75215]:     <memballoon model='virtio'>
Nov 11 01:34:31 user nova-compute[75215]:       <stats period='10'/>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='balloon0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </memballoon>
Nov 11 01:34:31 user nova-compute[75215]:     <rng model='virtio'>
Nov 11 01:34:31 user nova-compute[75215]:       <backend model='random'>/dev/urandom</backend>
Nov 11 01:34:31 user nova-compute[75215]:       <alias name='rng0'/>
Nov 11 01:34:31 user nova-compute[75215]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 11 01:34:31 user nova-compute[75215]:     </rng>
Nov 11 01:34:31 user nova-compute[75215]:   </devices>
Nov 11 01:34:31 user nova-compute[75215]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 11 01:34:31 user nova-compute[75215]:     <label>libvirt-c7c8d8f5-5e51-4e02-8001-ea843090f471</label>
Nov 11 01:34:31 user nova-compute[75215]:     <imagelabel>libvirt-c7c8d8f5-5e51-4e02-8001-ea843090f471</imagelabel>
Nov 11 01:34:31 user nova-compute[75215]:   </seclabel>
Nov 11 01:34:31 user nova-compute[75215]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 11 01:34:31 user nova-compute[75215]:     <label>+64055:+108</label>
Nov 11 01:34:31 user nova-compute[75215]:     <imagelabel>+64055:+108</imagelabel>
Nov 11 01:34:31 user nova-compute[75215]:   </seclabel>
Nov 11 01:34:31 user nova-compute[75215]: </domain>
Nov 11 01:34:31 user nova-compute[75215]:  {{(pid=75215) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 11 01:34:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Detaching interface fa:16:3e:45:5a:32 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap76a7c0e1-39' not found.
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Converting VIF {"id": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "address": "fa:16:3e:45:5a:32", "network": {"id": "c6305506-f76e-4553-a312-8bae5f02c7dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2057536410", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7c0e1-39", "ovs_interfaceid": "76a7c0e1-3978-4f0a-825a-bf6bd5f36095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG os_vif [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76a7c0e1-39, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:34:31 user nova-compute[75215]: INFO os_vif [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=76a7c0e1-3978-4f0a-825a-bf6bd5f36095,network=Network(c6305506-f76e-4553-a312-8bae5f02c7dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7c0e1-39')
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [req-e9dee24b-1a21-4ece-82a6-253dac277f56 req-86ce9f95-01bf-443a-9a19-a0db7338c8ce service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:34:31 user nova-compute[75215]:   <nova:package version="0.0.0"/>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:name>tempest-device-tagging-server-1881855644</nova:name>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:creationTime>2023-11-11 01:34:31</nova:creationTime>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:flavor name="m1.tiny">
Nov 11 01:34:31 user nova-compute[75215]:     <nova:memory>512</nova:memory>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:disk>1</nova:disk>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:swap>0</nova:swap>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:vcpus>1</nova:vcpus>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:flavor>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:owner>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:user uuid="6269f798c52c45ee9ca9aa29a4487798">tempest-TaggedAttachmentsTest-1511763889-project-member</nova:user>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:project uuid="e369e597968643269939d15256b6ae97">tempest-TaggedAttachmentsTest-1511763889</nova:project>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:owner>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:34:31 user nova-compute[75215]:   <nova:ports>
Nov 11 01:34:31 user nova-compute[75215]:     <nova:port uuid="997c39fb-7e21-4af1-acf2-e0e70157b02d">
Nov 11 01:34:31 user nova-compute[75215]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:34:31 user nova-compute[75215]:     </nova:port>
Nov 11 01:34:31 user nova-compute[75215]:   </nova:ports>
Nov 11 01:34:31 user nova-compute[75215]: </nova:instance>
Nov 11 01:34:31 user nova-compute[75215]:  {{(pid=75215) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 11 01:34:31 user nova-compute[75215]: INFO nova.network.neutron [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Port 76a7c0e1-3978-4f0a-825a-bf6bd5f36095 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 11 01:34:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating instance_info_cache with network_info: [{"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Releasing lock "refresh_cache-c7c8d8f5-5e51-4e02-8001-ea843090f471" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:34:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9a2a2ce6-b1ad-4484-b646-0352b318c32b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "interface-c7c8d8f5-5e51-4e02-8001-ea843090f471-76a7c0e1-3978-4f0a-825a-bf6bd5f36095" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.561s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lazy-loading 'flavor' on Instance uuid ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a1d7ff1c-ba97-4d58-8196-160da02ee44d tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 49.590s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:34:37 user nova-compute[75215]: INFO nova.compute.claims [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Claim successful on node user
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:34:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.policy [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80c298c7b4074bbcab91160215fb8537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edee432deba4b9fa073619e1f9d99bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:34:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Creating image(s)
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "/opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "/opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "/opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Successfully created port: 2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk 1073741824" returned: 0 in 0.053s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Cannot resize image /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Ensure instance console log exists: /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Successfully updated port: 2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "refresh_cache-891f58ec-3924-4c75-b9cd-08d7f1f0f242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquired lock "refresh_cache-891f58ec-3924-4c75-b9cd-08d7f1f0f242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-fbb108cc-3971-4101-8225-acc4eed0685e req-6e5c6aea-ab09-41b1-b735-1088fb0c1286 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received event network-changed-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-fbb108cc-3971-4101-8225-acc4eed0685e req-6e5c6aea-ab09-41b1-b735-1088fb0c1286 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Refreshing instance network info cache due to event network-changed-2946a312-cdf0-42fc-b6a5-1e9038a98f21. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:34:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbb108cc-3971-4101-8225-acc4eed0685e req-6e5c6aea-ab09-41b1-b735-1088fb0c1286 service nova] Acquiring lock "refresh_cache-891f58ec-3924-4c75-b9cd-08d7f1f0f242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Updating instance_info_cache with network_info: [{"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Releasing lock "refresh_cache-891f58ec-3924-4c75-b9cd-08d7f1f0f242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Instance network_info: |[{"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbb108cc-3971-4101-8225-acc4eed0685e req-6e5c6aea-ab09-41b1-b735-1088fb0c1286 service nova] Acquired lock "refresh_cache-891f58ec-3924-4c75-b9cd-08d7f1f0f242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-fbb108cc-3971-4101-8225-acc4eed0685e req-6e5c6aea-ab09-41b1-b735-1088fb0c1286 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Refreshing network info cache for port 2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Start _get_guest_xml network_info=[{"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:34:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:34:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2039148573',display_name='tempest-VolumesAdminNegativeTest-server-2039148573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2039148573',id=15,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9edee432deba4b9fa073619e1f9d99bb',ramdisk_id='',reservation_id='r-47dkj1lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1899827326',owner_user_name='tempest-VolumesAdminNegativeTest-1899827326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:34:38Z,user_data=None,user_id='80c298c7b4074bbcab91160215fb8537',uuid=891f58ec-3924-4c75-b9cd-08d7f1f0f242,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converting VIF {"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=2946a312-cdf0-42fc-b6a5-1e9038a98f21,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2946a312-cd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lazy-loading 'pci_devices' on Instance uuid 891f58ec-3924-4c75-b9cd-08d7f1f0f242 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:34:39 user nova-compute[75215]:   <uuid>891f58ec-3924-4c75-b9cd-08d7f1f0f242</uuid>
Nov 11 01:34:39 user nova-compute[75215]:   <name>instance-0000000f</name>
Nov 11 01:34:39 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:34:39 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:34:39 user nova-compute[75215]:   <metadata>
Nov 11 01:34:39 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:34:39 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:34:39 user nova-compute[75215]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2039148573</nova:name>
Nov 11 01:34:39 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:34:39</nova:creationTime>
Nov 11 01:34:39 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:34:39 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:34:39 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:34:39 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:34:39 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:34:39 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:34:39 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:34:39 user nova-compute[75215]:       <nova:owner>
Nov 11 01:34:39 user nova-compute[75215]:         <nova:user uuid="80c298c7b4074bbcab91160215fb8537">tempest-VolumesAdminNegativeTest-1899827326-project-member</nova:user>
Nov 11 01:34:39 user nova-compute[75215]:         <nova:project uuid="9edee432deba4b9fa073619e1f9d99bb">tempest-VolumesAdminNegativeTest-1899827326</nova:project>
Nov 11 01:34:39 user nova-compute[75215]:       </nova:owner>
Nov 11 01:34:39 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:34:39 user nova-compute[75215]:       <nova:ports>
Nov 11 01:34:39 user nova-compute[75215]:         <nova:port uuid="2946a312-cdf0-42fc-b6a5-1e9038a98f21">
Nov 11 01:34:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:34:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:34:39 user nova-compute[75215]:       </nova:ports>
Nov 11 01:34:39 user nova-compute[75215]:     </nova:instance>
Nov 11 01:34:39 user nova-compute[75215]:   </metadata>
Nov 11 01:34:39 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:34:39 user nova-compute[75215]:     <system>
Nov 11 01:34:39 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:34:39 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:34:39 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:34:39 user nova-compute[75215]:       <entry name="serial">891f58ec-3924-4c75-b9cd-08d7f1f0f242</entry>
Nov 11 01:34:39 user nova-compute[75215]:       <entry name="uuid">891f58ec-3924-4c75-b9cd-08d7f1f0f242</entry>
Nov 11 01:34:39 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:34:39 user nova-compute[75215]:     </system>
Nov 11 01:34:39 user nova-compute[75215]:   </sysinfo>
Nov 11 01:34:39 user nova-compute[75215]:   <os>
Nov 11 01:34:39 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:34:39 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:34:39 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:34:39 user nova-compute[75215]:   </os>
Nov 11 01:34:39 user nova-compute[75215]:   <features>
Nov 11 01:34:39 user nova-compute[75215]:     <acpi/>
Nov 11 01:34:39 user nova-compute[75215]:     <apic/>
Nov 11 01:34:39 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:34:39 user nova-compute[75215]:   </features>
Nov 11 01:34:39 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:34:39 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:34:39 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:34:39 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:34:39 user nova-compute[75215]:   </clock>
Nov 11 01:34:39 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:34:39 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:34:39 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:34:39 user nova-compute[75215]:   </cpu>
Nov 11 01:34:39 user nova-compute[75215]:   <devices>
Nov 11 01:34:39 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:34:39 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:34:39 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk"/>
Nov 11 01:34:39 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:34:39 user nova-compute[75215]:     </disk>
Nov 11 01:34:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:34:39 user nova-compute[75215]:       <mac address="fa:16:3e:7e:1c:0e"/>
Nov 11 01:34:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:34:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:34:39 user nova-compute[75215]:       <target dev="tap2946a312-cd"/>
Nov 11 01:34:39 user nova-compute[75215]:     </interface>
Nov 11 01:34:39 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:34:39 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/console.log" append="off"/>
Nov 11 01:34:39 user nova-compute[75215]:     </serial>
Nov 11 01:34:39 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:34:39 user nova-compute[75215]:     <video>
Nov 11 01:34:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:34:39 user nova-compute[75215]:     </video>
Nov 11 01:34:39 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:34:39 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:34:39 user nova-compute[75215]:     </rng>
Nov 11 01:34:39 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:34:39 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:34:39 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:34:39 user nova-compute[75215]:     </memballoon>
Nov 11 01:34:39 user nova-compute[75215]:   </devices>
Nov 11 01:34:39 user nova-compute[75215]: </domain>
Nov 11 01:34:39 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2039148573',display_name='tempest-VolumesAdminNegativeTest-server-2039148573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2039148573',id=15,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9edee432deba4b9fa073619e1f9d99bb',ramdisk_id='',reservation_id='r-47dkj1lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1899827326',owner_user_name='tempest-VolumesAdminNegativeTest-1899827326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:34:38Z,user_data=None,user_id='80c298c7b4074bbcab91160215fb8537',uuid=891f58ec-3924-4c75-b9cd-08d7f1f0f242,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converting VIF {"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=2946a312-cdf0-42fc-b6a5-1e9038a98f21,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2946a312-cd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG os_vif [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=2946a312-cdf0-42fc-b6a5-1e9038a98f21,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2946a312-cd') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9ccc8f4-1cf3-5fb2-9659-9d8d2314598f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2946a312-cd, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2946a312-cd, col_values=(('qos', UUID('0dea3d2b-e2da-4099-8540-933865e20439')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2946a312-cd, col_values=(('external_ids', {'iface-id': '2946a312-cdf0-42fc-b6a5-1e9038a98f21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:1c:0e', 'vm-uuid': '891f58ec-3924-4c75-b9cd-08d7f1f0f242'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:39 user nova-compute[75215]: INFO os_vif [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=2946a312-cdf0-42fc-b6a5-1e9038a98f21,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2946a312-cd')
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] No VIF found with MAC fa:16:3e:7e:1c:0e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-fbb108cc-3971-4101-8225-acc4eed0685e req-6e5c6aea-ab09-41b1-b735-1088fb0c1286 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Updated VIF entry in instance network info cache for port 2946a312-cdf0-42fc-b6a5-1e9038a98f21. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-fbb108cc-3971-4101-8225-acc4eed0685e req-6e5c6aea-ab09-41b1-b735-1088fb0c1286 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Updating instance_info_cache with network_info: [{"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:34:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbb108cc-3971-4101-8225-acc4eed0685e req-6e5c6aea-ab09-41b1-b735-1088fb0c1286 service nova] Releasing lock "refresh_cache-891f58ec-3924-4c75-b9cd-08d7f1f0f242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:34:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a57946f-e50f-45d5-af10-6b2a8dfbc166 req-3284397a-fd8d-49cf-bf28-53b9233340d9 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received event network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a57946f-e50f-45d5-af10-6b2a8dfbc166 req-3284397a-fd8d-49cf-bf28-53b9233340d9 service nova] Acquiring lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a57946f-e50f-45d5-af10-6b2a8dfbc166 req-3284397a-fd8d-49cf-bf28-53b9233340d9 service nova] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a57946f-e50f-45d5-af10-6b2a8dfbc166 req-3284397a-fd8d-49cf-bf28-53b9233340d9 service nova] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a57946f-e50f-45d5-af10-6b2a8dfbc166 req-3284397a-fd8d-49cf-bf28-53b9233340d9 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] No waiting events found dispatching network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:41 user nova-compute[75215]: WARNING nova.compute.manager [req-7a57946f-e50f-45d5-af10-6b2a8dfbc166 req-3284397a-fd8d-49cf-bf28-53b9233340d9 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received unexpected event network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 for instance with vm_state building and task_state spawning.
Nov 11 01:34:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:34:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Instance spawned successfully.
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:34:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-932d61a5-2413-4712-a360-bf41150b7cc9 req-790d9922-eaae-46b5-8c5a-54c8128efc34 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received event network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-932d61a5-2413-4712-a360-bf41150b7cc9 req-790d9922-eaae-46b5-8c5a-54c8128efc34 service nova] Acquiring lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-932d61a5-2413-4712-a360-bf41150b7cc9 req-790d9922-eaae-46b5-8c5a-54c8128efc34 service nova] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-932d61a5-2413-4712-a360-bf41150b7cc9 req-790d9922-eaae-46b5-8c5a-54c8128efc34 service nova] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-932d61a5-2413-4712-a360-bf41150b7cc9 req-790d9922-eaae-46b5-8c5a-54c8128efc34 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] No waiting events found dispatching network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:34:43 user nova-compute[75215]: WARNING nova.compute.manager [req-932d61a5-2413-4712-a360-bf41150b7cc9 req-790d9922-eaae-46b5-8c5a-54c8128efc34 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received unexpected event network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 for instance with vm_state building and task_state spawning.
Nov 11 01:34:43 user nova-compute[75215]: INFO nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 11 01:34:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:34:43 user nova-compute[75215]: INFO nova.compute.manager [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Took 6.28 seconds to build instance.
Nov 11 01:34:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a25fa5a6-a8bc-4fd2-a657-4f2255af239f tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.424s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:45 user nova-compute[75215]: WARNING nova.compute.manager [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Timeout waiting for ['volume-reimaged-02bab4fc-3d0f-449a-b7a0-ef86c368498c'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-02bab4fc-3d0f-449a-b7a0-ef86c368498c: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Nov 11 01:34:45 user nova-compute[75215]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7f40444e7ca0 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Nov 11 01:34:45 user nova-compute[75215]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Nov 11 01:34:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:46 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:34:46 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:34:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:46 user nova-compute[75215]: INFO nova.compute.manager [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Successfully reverted task state from rebuilding on failure for instance.
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Exception during message handling: ValueError: Circular reference detected
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     next(self.gen)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Nov 11 01:34:46 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 11 01:34:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad req-6bf31d2d-858d-4687-9b81-50a514580ae1 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received event volume-reimaged-02bab4fc-3d0f-449a-b7a0-ef86c368498c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:34:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad req-6bf31d2d-858d-4687-9b81-50a514580ae1 service nova] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:34:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad req-6bf31d2d-858d-4687-9b81-50a514580ae1 service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:34:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad req-6bf31d2d-858d-4687-9b81-50a514580ae1 service nova] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:34:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-0b38f2d7-3ceb-4789-8ad3-25d024d247ad req-6bf31d2d-858d-4687-9b81-50a514580ae1 service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Processing event volume-reimaged-02bab4fc-3d0f-449a-b7a0-ef86c368498c {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 11 01:34:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:34:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:34:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:01 user nova-compute[75215]: INFO nova.compute.manager [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Terminating instance
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquired lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'info_cache' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-b8fb45db-37cb-4793-8a58-ec53d0752b22 req-39ba6375-8fe0-472a-9c59-4e413943585a service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-unplugged-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b8fb45db-37cb-4793-8a58-ec53d0752b22 req-39ba6375-8fe0-472a-9c59-4e413943585a service nova] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b8fb45db-37cb-4793-8a58-ec53d0752b22 req-39ba6375-8fe0-472a-9c59-4e413943585a service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b8fb45db-37cb-4793-8a58-ec53d0752b22 req-39ba6375-8fe0-472a-9c59-4e413943585a service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-b8fb45db-37cb-4793-8a58-ec53d0752b22 req-39ba6375-8fe0-472a-9c59-4e413943585a service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] No waiting events found dispatching network-vif-unplugged-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-b8fb45db-37cb-4793-8a58-ec53d0752b22 req-39ba6375-8fe0-472a-9c59-4e413943585a service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-unplugged-997c39fb-7e21-4af1-acf2-e0e70157b02d for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Instance destroyed successfully.
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lazy-loading 'resources' on Instance uuid c7c8d8f5-5e51-4e02-8001-ea843090f471 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881855644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881855644',id=8,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwlW6DkZ112UWMq7WMWwzW2SwJ923q2KOeU2d/4owlEzzkWFOXsxCS3kBgB6WR2k0J3x9tS9yH3b7oX2/rFdb2wilxWZiES8NPcM5dz/W5XGFQnefhdeN/DX3zGdfG9BA==',key_name='tempest-keypair-1801401306',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e369e597968643269939d15256b6ae97',ramdisk_id='',reservation_id='r-f5hbxbx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1511763889',owner_user_name='tempest-TaggedAttachmentsTest-1511763889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6269f798c52c45ee9ca9aa29a4487798',uuid=c7c8d8f5-5e51-4e02-8001-ea843090f471,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converting VIF {"id": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "address": "fa:16:3e:95:05:3a", "network": {"id": "6915f72f-6c26-4506-a9b7-ab1baa663e62", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1430394421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e369e597968643269939d15256b6ae97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap997c39fb-7e", "ovs_interfaceid": "997c39fb-7e21-4af1-acf2-e0e70157b02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=997c39fb-7e21-4af1-acf2-e0e70157b02d,network=Network(6915f72f-6c26-4506-a9b7-ab1baa663e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap997c39fb-7e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG os_vif [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=997c39fb-7e21-4af1-acf2-e0e70157b02d,network=Network(6915f72f-6c26-4506-a9b7-ab1baa663e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap997c39fb-7e') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap997c39fb-7e, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=938f121c-a77e-4869-94fb-9219179df85f) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:01 user nova-compute[75215]: INFO os_vif [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=997c39fb-7e21-4af1-acf2-e0e70157b02d,network=Network(6915f72f-6c26-4506-a9b7-ab1baa663e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap997c39fb-7e')
Nov 11 01:35:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Deleting instance files /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471_del
Nov 11 01:35:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Deletion of /opt/stack/data/nova/instances/c7c8d8f5-5e51-4e02-8001-ea843090f471_del complete
Nov 11 01:35:02 user nova-compute[75215]: INFO nova.compute.manager [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Releasing lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:35:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance destroyed successfully.
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'resources' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.objects.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_vif [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fd51c5f-2f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e159fa8-c829-4c82-98a1-700074a6494e) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:02 user nova-compute[75215]: INFO os_vif [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f')
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veykfYdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:02 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8b9ca2-7724-462a-ae1f-02bb2bbba5fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:35:02 user nova-compute[75215]: No targets found.
Nov 11 01:35:02 user nova-compute[75215]: iSNS:
Nov 11 01:35:02 user nova-compute[75215]: No targets found.
Nov 11 01:35:02 user nova-compute[75215]: STATIC:
Nov 11 01:35:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:35:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:02 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:35:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:02 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:35:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:02 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d
Nov 11 01:35:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:02 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:35:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:02 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:02 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:35:02 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:02 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:02 user nova-compute[75215]: FIRMWARE:
Nov 11 01:35:02 user nova-compute[75215]: No targets found.
Nov 11 01:35:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:35:02 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:35:02 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[130d9b79-42a8-484b-a1b7-5284e4ba1874]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7406e314-8916-44bb-96de-1f921c36565d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:02 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404437c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba57a8e-90b8-4935-ae2a-6081b1a58c25]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e73c19-b5c4-4439-98dc-303b305aab18]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87280f4-1179-4eb9-a188-8f4e0a04678c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93054c1-82bf-4ad2-b27d-3e20f461314a]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[761d026d-2934-4dde-a482-5857aea375f1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ac04cf-8202-42a5-b675-c25bea8e4a57]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260]
Nov 11 01:35:02 user nova-compute[75215]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260] successful.
Nov 11 01:35:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61762572-ef94-43ae-930c-fec6f59b3f73]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== disconnect_volume: return (370ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Start _get_guest_xml network_info=[{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '715b1ebd-3ee0-40e3-b53b-0842bfe8ad88', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veykfYdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '29f5d275-78e7-4292-98c8-d12f47f28fbf', 'attached_at': '', 'detached_at': '', 'volume_id': '36d2eade-7266-431a-841c-7bd5c33569e5', 'serial': '36d2eade-7266-431a-841c-7bd5c33569e5'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:35:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'numa_topology' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.objects.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:35:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'vcpu_model' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.objects.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veykfYdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:03 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc12e1-233d-4ee4-b700-efcd69bc987e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:35:03 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ffb6b0-2129-4fb5-8b21-556d55ffb979]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5] added
Nov 11 01:35:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3d5f5-a425-4d24-bbbe-e438e0e273e0]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f979a59e-1aa4-456a-b034-8b680fcfb549]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veykfYdt {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veykfYdt" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a99c652-1fdc-48aa-b249-d6a800a45cb9]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'veykfYdt'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43c67de-4324-42f7-b6f6-e52f25b25317]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b31fe27-9eed-4a74-b486-f6113bc5eecd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Took 1.21 seconds to deallocate network for instance.
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-56e40b16-3e81-42b3-841e-c67b09026196 req-8fd34498-70e7-42be-bf81-1b7af97a38a2 service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-deleted-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3522b55f-a68a-46f3-8c93-47a5e9b21535]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260]
Nov 11 01:35:03 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260] successful.
Nov 11 01:35:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16c498-519a-40bc-b925-22d0c171a96a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c08678-986b-4a0d-93e3-a295c0c8e018]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:03 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[162d1198-2b96-46f5-a96c-9916216c5888]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veykfYdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb3d66fe-a1a7-47de-a4ee-03bc03868316 req-2b68801b-a655-4781-9855-44703d8cedbe service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received event network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb3d66fe-a1a7-47de-a4ee-03bc03868316 req-2b68801b-a655-4781-9855-44703d8cedbe service nova] Acquiring lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb3d66fe-a1a7-47de-a4ee-03bc03868316 req-2b68801b-a655-4781-9855-44703d8cedbe service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb3d66fe-a1a7-47de-a4ee-03bc03868316 req-2b68801b-a655-4781-9855-44703d8cedbe service nova] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb3d66fe-a1a7-47de-a4ee-03bc03868316 req-2b68801b-a655-4781-9855-44703d8cedbe service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] No waiting events found dispatching network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:03 user nova-compute[75215]: WARNING nova.compute.manager [req-fb3d66fe-a1a7-47de-a4ee-03bc03868316 req-2b68801b-a655-4781-9855-44703d8cedbe service nova] [instance: c7c8d8f5-5e51-4e02-8001-ea843090f471] Received unexpected event network-vif-plugged-997c39fb-7e21-4af1-acf2-e0e70157b02d for instance with vm_state deleted and task_state None.
Nov 11 01:35:03 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Deleted allocations for instance c7c8d8f5-5e51-4e02-8001-ea843090f471
Nov 11 01:35:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8361860f-4d82-491e-99df-a81a4ac7990b tempest-TaggedAttachmentsTest-1511763889 tempest-TaggedAttachmentsTest-1511763889-project-member] Lock "c7c8d8f5-5e51-4e02-8001-ea843090f471" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.861s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26463383830633731', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463383830633731', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'pci_devices' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.objects.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:35:04 user nova-compute[75215]:   <uuid>29f5d275-78e7-4292-98c8-d12f47f28fbf</uuid>
Nov 11 01:35:04 user nova-compute[75215]:   <name>instance-00000004</name>
Nov 11 01:35:04 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:35:04 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:35:04 user nova-compute[75215]:   <metadata>
Nov 11 01:35:04 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:35:04 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:35:04 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeTestJSON-server-1742806291</nova:name>
Nov 11 01:35:04 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:35:03</nova:creationTime>
Nov 11 01:35:04 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:35:04 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:35:04 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:35:04 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:35:04 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:35:04 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:35:04 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:35:04 user nova-compute[75215]:       <nova:owner>
Nov 11 01:35:04 user nova-compute[75215]:         <nova:user uuid="285cd483fbdc4e4faec7a1bbd414ca7f">tempest-AttachVolumeTestJSON-1999559004-project-member</nova:user>
Nov 11 01:35:04 user nova-compute[75215]:         <nova:project uuid="f71c4317ced540a1a841f41cb9929b7b">tempest-AttachVolumeTestJSON-1999559004</nova:project>
Nov 11 01:35:04 user nova-compute[75215]:       </nova:owner>
Nov 11 01:35:04 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:35:04 user nova-compute[75215]:       <nova:ports>
Nov 11 01:35:04 user nova-compute[75215]:         <nova:port uuid="9fd51c5f-2f3b-4df5-92c8-3d84fe37691b">
Nov 11 01:35:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:35:04 user nova-compute[75215]:         </nova:port>
Nov 11 01:35:04 user nova-compute[75215]:       </nova:ports>
Nov 11 01:35:04 user nova-compute[75215]:     </nova:instance>
Nov 11 01:35:04 user nova-compute[75215]:   </metadata>
Nov 11 01:35:04 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:35:04 user nova-compute[75215]:     <system>
Nov 11 01:35:04 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:35:04 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:35:04 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:35:04 user nova-compute[75215]:       <entry name="serial">29f5d275-78e7-4292-98c8-d12f47f28fbf</entry>
Nov 11 01:35:04 user nova-compute[75215]:       <entry name="uuid">29f5d275-78e7-4292-98c8-d12f47f28fbf</entry>
Nov 11 01:35:04 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:35:04 user nova-compute[75215]:     </system>
Nov 11 01:35:04 user nova-compute[75215]:   </sysinfo>
Nov 11 01:35:04 user nova-compute[75215]:   <os>
Nov 11 01:35:04 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:35:04 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:35:04 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:35:04 user nova-compute[75215]:   </os>
Nov 11 01:35:04 user nova-compute[75215]:   <features>
Nov 11 01:35:04 user nova-compute[75215]:     <acpi/>
Nov 11 01:35:04 user nova-compute[75215]:     <apic/>
Nov 11 01:35:04 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:35:04 user nova-compute[75215]:   </features>
Nov 11 01:35:04 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:35:04 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:35:04 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:35:04 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:35:04 user nova-compute[75215]:   </clock>
Nov 11 01:35:04 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:35:04 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:35:04 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:35:04 user nova-compute[75215]:   </cpu>
Nov 11 01:35:04 user nova-compute[75215]:   <devices>
Nov 11 01:35:04 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:35:04 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:35:04 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk"/>
Nov 11 01:35:04 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:35:04 user nova-compute[75215]:     </disk>
Nov 11 01:35:04 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:35:04 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:35:04 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 11 01:35:04 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:35:04 user nova-compute[75215]:       <serial>36d2eade-7266-431a-841c-7bd5c33569e5</serial>
Nov 11 01:35:04 user nova-compute[75215]:     </disk>
Nov 11 01:35:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:35:04 user nova-compute[75215]:       <mac address="fa:16:3e:7e:c3:e5"/>
Nov 11 01:35:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:35:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:35:04 user nova-compute[75215]:       <target dev="tap9fd51c5f-2f"/>
Nov 11 01:35:04 user nova-compute[75215]:     </interface>
Nov 11 01:35:04 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:35:04 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/console.log" append="off"/>
Nov 11 01:35:04 user nova-compute[75215]:     </serial>
Nov 11 01:35:04 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:35:04 user nova-compute[75215]:     <video>
Nov 11 01:35:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:35:04 user nova-compute[75215]:     </video>
Nov 11 01:35:04 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:35:04 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:35:04 user nova-compute[75215]:     </rng>
Nov 11 01:35:04 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:35:04 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:35:04 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:35:04 user nova-compute[75215]:     </memballoon>
Nov 11 01:35:04 user nova-compute[75215]:   </devices>
Nov 11 01:35:04 user nova-compute[75215]: </domain>
Nov 11 01:35:04 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'trusted_certs' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG nova.objects.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Cannot resize image /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'migration_context' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG nova.objects.base [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG os_vif [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ceffea16-bab8-5bca-9457-dc3e6e10fd5a', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fd51c5f-2f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fd51c5f-2f, col_values=(('qos', UUID('4a2fad1a-71db-44cc-ac26-243b2fb61bee')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fd51c5f-2f, col_values=(('external_ids', {'iface-id': '9fd51c5f-2f3b-4df5-92c8-3d84fe37691b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:c3:e5', 'vm-uuid': '29f5d275-78e7-4292-98c8-d12f47f28fbf'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:05 user nova-compute[75215]: INFO os_vif [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f')
Nov 11 01:35:06 user nova-compute[75215]: INFO nova.compute.manager [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Rescuing
Nov 11 01:35:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:35:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquired lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:35:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:35:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updating instance_info_cache with network_info: [{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Releasing lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-7cb353d6-9897-466b-8eb3-173eefeff38a req-b3c70cce-e6eb-4d17-8df5-302a9017108d service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7cb353d6-9897-466b-8eb3-173eefeff38a req-b3c70cce-e6eb-4d17-8df5-302a9017108d service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7cb353d6-9897-466b-8eb3-173eefeff38a req-b3c70cce-e6eb-4d17-8df5-302a9017108d service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7cb353d6-9897-466b-8eb3-173eefeff38a req-b3c70cce-e6eb-4d17-8df5-302a9017108d service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-7cb353d6-9897-466b-8eb3-173eefeff38a req-b3c70cce-e6eb-4d17-8df5-302a9017108d service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:07 user nova-compute[75215]: WARNING nova.compute.manager [req-7cb353d6-9897-466b-8eb3-173eefeff38a req-b3c70cce-e6eb-4d17-8df5-302a9017108d service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state active and task_state rescuing.
Nov 11 01:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-7760b248-a631-4b61-a57a-a253470dab17 req-9a2b1292-d2a9-4fb9-8401-f1d432156990 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7760b248-a631-4b61-a57a-a253470dab17 req-9a2b1292-d2a9-4fb9-8401-f1d432156990 service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7760b248-a631-4b61-a57a-a253470dab17 req-9a2b1292-d2a9-4fb9-8401-f1d432156990 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7760b248-a631-4b61-a57a-a253470dab17 req-9a2b1292-d2a9-4fb9-8401-f1d432156990 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-7760b248-a631-4b61-a57a-a253470dab17 req-9a2b1292-d2a9-4fb9-8401-f1d432156990 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:07 user nova-compute[75215]: WARNING nova.compute.manager [req-7760b248-a631-4b61-a57a-a253470dab17 req-9a2b1292-d2a9-4fb9-8401-f1d432156990 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state stopped and task_state powering-on.
Nov 11 01:35:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance destroyed successfully.
Nov 11 01:35:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Attempting a stable device rescue
Nov 11 01:35:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 01:35:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 01:35:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Creating image(s)
Nov 11 01:35:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "/opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "/opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "/opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'trusted_certs' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "b62580a274afb19c54c8fb30575b2fe921e6b6d6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b62580a274afb19c54c8fb30575b2fe921e6b6d6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:09 user nova-compute[75215]: INFO nova.compute.manager [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Terminating instance
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6.part --force-share --output=json" returned: 0 in 0.244s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.virt.images [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] e9b50c68-92f5-4441-99b0-fd496e50e1ee was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6.part /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-15f21a0f-2246-4532-afa7-a48508ea6bbf req-dfd20c74-e8c2-4f93-9657-9d6d3f8d2071 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15f21a0f-2246-4532-afa7-a48508ea6bbf req-dfd20c74-e8c2-4f93-9657-9d6d3f8d2071 service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15f21a0f-2246-4532-afa7-a48508ea6bbf req-dfd20c74-e8c2-4f93-9657-9d6d3f8d2071 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15f21a0f-2246-4532-afa7-a48508ea6bbf req-dfd20c74-e8c2-4f93-9657-9d6d3f8d2071 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-15f21a0f-2246-4532-afa7-a48508ea6bbf req-dfd20c74-e8c2-4f93-9657-9d6d3f8d2071 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:09 user nova-compute[75215]: WARNING nova.compute.manager [req-15f21a0f-2246-4532-afa7-a48508ea6bbf req-dfd20c74-e8c2-4f93-9657-9d6d3f8d2071 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state active and task_state rescuing.
Nov 11 01:35:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-32b8cad8-fbaa-4367-8819-2e26f7dc923f req-127d493c-3333-4968-a9b5-1a6c56ee0f3b service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32b8cad8-fbaa-4367-8819-2e26f7dc923f req-127d493c-3333-4968-a9b5-1a6c56ee0f3b service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32b8cad8-fbaa-4367-8819-2e26f7dc923f req-127d493c-3333-4968-a9b5-1a6c56ee0f3b service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32b8cad8-fbaa-4367-8819-2e26f7dc923f req-127d493c-3333-4968-a9b5-1a6c56ee0f3b service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-32b8cad8-fbaa-4367-8819-2e26f7dc923f req-127d493c-3333-4968-a9b5-1a6c56ee0f3b service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:09 user nova-compute[75215]: WARNING nova.compute.manager [req-32b8cad8-fbaa-4367-8819-2e26f7dc923f req-127d493c-3333-4968-a9b5-1a6c56ee0f3b service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state stopped and task_state powering-on.
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6.part /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6.converted" returned: 0 in 0.544s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Instance destroyed successfully.
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lazy-loading 'resources' on Instance uuid a0456c90-8b61-44aa-9484-08d9a481f8a7 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1403311129',display_name='tempest-VolumesAssistedSnapshotsTest-server-1403311129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1403311129',id=9,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZmTg+DOi4RN5ggEz+IIuzljuHtgn0WykFbG90l787ReZKRbbVqgPKHzDwalGANCWEJWsoWI0GToXeAXR7NuWQ7D8pAZI77j7PxBDTbIu3C19aXyMdszc8erzMeSOEY8A==',key_name='tempest-keypair-825998623',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4271fe9e96c4367b321196578f8dd20',ramdisk_id='',reservation_id='r-0mmtp3zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1475212709',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1475212709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='387a12092fd94ce6816c35cb1dfe655c',uuid=a0456c90-8b61-44aa-9484-08d9a481f8a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Converting VIF {"id": "9f846e49-33b9-4b5c-a170-258eeae8471f", "address": "fa:16:3e:00:a6:85", "network": {"id": "db589161-49d2-4749-9185-d0fc915149d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1010989957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4271fe9e96c4367b321196578f8dd20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f846e49-33", "ovs_interfaceid": "9f846e49-33b9-4b5c-a170-258eeae8471f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:a6:85,bridge_name='br-int',has_traffic_filtering=True,id=9f846e49-33b9-4b5c-a170-258eeae8471f,network=Network(db589161-49d2-4749-9185-d0fc915149d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f846e49-33') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_vif [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:a6:85,bridge_name='br-int',has_traffic_filtering=True,id=9f846e49-33b9-4b5c-a170-258eeae8471f,network=Network(db589161-49d2-4749-9185-d0fc915149d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f846e49-33') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f846e49-33, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b62580a274afb19c54c8fb30575b2fe921e6b6d6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.107s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "b62580a274afb19c54c8fb30575b2fe921e6b6d6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b62580a274afb19c54c8fb30575b2fe921e6b6d6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed99e8b9-9a5e-4131-99dc-0c2422204331) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:10 user nova-compute[75215]: INFO os_vif [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:a6:85,bridge_name='br-int',has_traffic_filtering=True,id=9f846e49-33b9-4b5c-a170-258eeae8471f,network=Network(db589161-49d2-4749-9185-d0fc915149d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f846e49-33')
Nov 11 01:35:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Deleting instance files /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7_del
Nov 11 01:35:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Deletion of /opt/stack/data/nova/instances/a0456c90-8b61-44aa-9484-08d9a481f8a7_del complete
Nov 11 01:35:10 user nova-compute[75215]: INFO nova.compute.manager [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:35:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance rebooted successfully.
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c77db40a-d15a-4255-9c12-bc272a2351d1 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6 --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6,backing_fmt=raw /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6,backing_fmt=raw /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue" returned: 0 in 0.055s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b62580a274afb19c54c8fb30575b2fe921e6b6d6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'migration_context' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<b372f84a-390e-4707-ad3c-8d9f0a7c8327> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Start _get_guest_xml network_info=[{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "vif_mac": "fa:16:3e:61:e5:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e9b50c68-92f5-4441-99b0-fd496e50e1ee', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'a2925e2d-1bf0-4937-9b97-7307a155ca06', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmriZxQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'b372f84a-390e-4707-ad3c-8d9f0a7c8327', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5756be5-b549-4aa5-a440-62df68449e6a', 'serial': 'b5756be5-b549-4aa5-a440-62df68449e6a'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'resources' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<b372f84a-390e-4707-ad3c-8d9f0a7c8327> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'numa_topology' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<b372f84a-390e-4707-ad3c-8d9f0a7c8327> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:10 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:35:10 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'vcpu_model' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<b372f84a-390e-4707-ad3c-8d9f0a7c8327> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmriZxQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:10 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63486f0-7b87-4fe1-a11e-fb888ad62e73]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YmriZxQe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 11 01:35:10 user nova-compute[75215]: node.name = iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:35:10 user nova-compute[75215]: node.tpgt = -1
Nov 11 01:35:10 user nova-compute[75215]: node.startup = automatic
Nov 11 01:35:10 user nova-compute[75215]: node.leading_login = No
Nov 11 01:35:10 user nova-compute[75215]: iface.iscsi_ifacename = default
Nov 11 01:35:10 user nova-compute[75215]: iface.net_ifacename = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.ipaddress = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.prefix_len = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.hwaddress = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.transport_name = tcp
Nov 11 01:35:10 user nova-compute[75215]: iface.initiatorname = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.state = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.vlan_id = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.vlan_priority = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.vlan_state = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.iface_num = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.mtu = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.port = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.bootproto = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.subnet_mask = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.gateway = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.dhcp_alt_client_id_state = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.dhcp_alt_client_id = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.dhcp_dns = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.dhcp_learn_iqn = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.dhcp_req_vendor_id_state = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.dhcp_vendor_id_state = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.dhcp_vendor_id = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.dhcp_slp_da = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.fragmentation = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.gratuitous_arp = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.incoming_forwarding = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.tos_state = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.tos = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.ttl = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.delayed_ack = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.tcp_nagle = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.tcp_wsf_state = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.tcp_wsf = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.tcp_timer_scale = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.tcp_timestamp = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.redirect = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.def_task_mgmt_timeout = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.header_digest = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.data_digest = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.immediate_data = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.initial_r2t = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.data_seq_inorder = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.data_pdu_inorder = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.erl = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.max_receive_data_len = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.first_burst_len = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.max_outstanding_r2t = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.max_burst_len = 0
Nov 11 01:35:10 user nova-compute[75215]: iface.chap_auth = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.bidi_chap = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.strict_login_compliance = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.discovery_auth = <empty>
Nov 11 01:35:10 user nova-compute[75215]: iface.discovery_logout = <empty>
Nov 11 01:35:10 user nova-compute[75215]: node.discovery_address = <empty>
Nov 11 01:35:10 user nova-compute[75215]: node.discovery_port = 0
Nov 11 01:35:10 user nova-compute[75215]: node.discovery_type = static
Nov 11 01:35:10 user nova-compute[75215]: node.session.initial_cmdsn = 0
Nov 11 01:35:10 user nova-compute[75215]: node.session.initial_login_retry_max = 8
Nov 11 01:35:10 user nova-compute[75215]: node.session.xmit_thread_priority = -20
Nov 11 01:35:10 user nova-compute[75215]: node.session.cmds_max = 128
Nov 11 01:35:10 user nova-compute[75215]: node.session.queue_depth = 32
Nov 11 01:35:10 user nova-compute[75215]: node.session.nr_sessions = 1
Nov 11 01:35:10 user nova-compute[75215]: node.session.auth.authmethod = CHAP
Nov 11 01:35:10 user nova-compute[75215]: node.session.auth.username = YmriZxQe
Nov 11 01:35:10 user nova-compute[75215]: node.session.auth.password = ***
Nov 11 01:35:10 user nova-compute[75215]: node.session.auth.username_in = <empty>
Nov 11 01:35:10 user nova-compute[75215]: node.session.auth.password_in = <empty>
Nov 11 01:35:10 user nova-compute[75215]: node.session.auth.chap_algs = MD5
Nov 11 01:35:10 user nova-compute[75215]: node.session.timeo.replacement_timeout = 120
Nov 11 01:35:10 user nova-compute[75215]: node.session.err_timeo.abort_timeout = 15
Nov 11 01:35:10 user nova-compute[75215]: node.session.err_timeo.lu_reset_timeout = 30
Nov 11 01:35:10 user nova-compute[75215]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 11 01:35:10 user nova-compute[75215]: node.session.err_timeo.host_reset_timeout = 60
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.FastAbort = Yes
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.InitialR2T = No
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.ImmediateData = Yes
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.FirstBurstLength = 262144
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.MaxBurstLength = 16776192
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.DefaultTime2Retain = 0
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.DefaultTime2Wait = 2
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.MaxConnections = 1
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 11 01:35:10 user nova-compute[75215]: node.session.iscsi.ERL = 0
Nov 11 01:35:10 user nova-compute[75215]: node.session.scan = manual
Nov 11 01:35:10 user nova-compute[75215]: node.session.reopen_max = 0
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].address = 172.16.0.220
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].port = 3260
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].startup = manual
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].tcp.window_size = 524288
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].tcp.type_of_service = 0
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].timeo.logout_timeout = 15
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].timeo.login_timeout = 15
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].timeo.auth_timeout = 45
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].timeo.noop_out_interval = 5
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].timeo.noop_out_timeout = 5
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].iscsi.HeaderDigest = None
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].iscsi.DataDigest = None
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].iscsi.IFMarker = No
Nov 11 01:35:10 user nova-compute[75215]: node.conn[0].iscsi.OFMarker = No
Nov 11 01:35:10 user nova-compute[75215]: # END RECORD
Nov 11 01:35:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.133s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9205b4b-7f6f-4b55-92c9-5bb55e3edcb7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4618fc04-9e38-46cb-9ae8-08832ad0b4fa]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmriZxQe {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmriZxQe" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[443c1ea8-7937-43d2-9da5-8f3683ff8a2a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YmriZxQe'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbae5350-3750-421d-b5cc-8485541c50ba]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'flavor' on Instance uuid 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d82b85-5b4b-46e8-bac9-9f44f0cf3063]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:10 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] HCTL ('39', '0', '0', 0) found on session 10 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[011dfa93-3d08-421e-9012-c73d964ee137]: (4, ('0 0 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching for a device in session 10 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmriZxQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.345s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] <== connect_volume: return (347ms) {'type': 'block', 'scsi_wwn': '23935383364343434', 'path': '/dev/sdh'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935383364343434', 'path': '/dev/sdh'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2103065644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2103065644',id=13,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:33:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-len87ys3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:33:52Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=b372f84a-390e-4707-ad3c-8d9f0a7c8327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "vif_mac": "fa:16:3e:61:e5:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "vif_mac": "fa:16:3e:61:e5:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:e5:81,bridge_name='br-int',has_traffic_filtering=True,id=427d21a8-099b-4a97-8428-39ba7ed4d384,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427d21a8-09') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'pci_devices' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.objects.base [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<b372f84a-390e-4707-ad3c-8d9f0a7c8327> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:35:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:35:10 user nova-compute[75215]:   <uuid>b372f84a-390e-4707-ad3c-8d9f0a7c8327</uuid>
Nov 11 01:35:10 user nova-compute[75215]:   <name>instance-0000000d</name>
Nov 11 01:35:10 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:35:10 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:35:10 user nova-compute[75215]:   <metadata>
Nov 11 01:35:10 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:35:10 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:35:10 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2103065644</nova:name>
Nov 11 01:35:10 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:35:10</nova:creationTime>
Nov 11 01:35:10 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:35:10 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:35:10 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:35:10 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:35:10 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:35:10 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:35:10 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:35:10 user nova-compute[75215]:       <nova:owner>
Nov 11 01:35:10 user nova-compute[75215]:         <nova:user uuid="561ad55121d44be1ab7971a495b9347f">tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member</nova:user>
Nov 11 01:35:10 user nova-compute[75215]:         <nova:project uuid="32564a70b861419eaefcb97cd327088d">tempest-ServerBootFromVolumeStableRescueTest-1327607516</nova:project>
Nov 11 01:35:10 user nova-compute[75215]:       </nova:owner>
Nov 11 01:35:10 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:35:10 user nova-compute[75215]:       <nova:ports>
Nov 11 01:35:10 user nova-compute[75215]:         <nova:port uuid="427d21a8-099b-4a97-8428-39ba7ed4d384">
Nov 11 01:35:10 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:35:10 user nova-compute[75215]:         </nova:port>
Nov 11 01:35:10 user nova-compute[75215]:       </nova:ports>
Nov 11 01:35:10 user nova-compute[75215]:     </nova:instance>
Nov 11 01:35:10 user nova-compute[75215]:   </metadata>
Nov 11 01:35:10 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:35:10 user nova-compute[75215]:     <system>
Nov 11 01:35:10 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:35:10 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:35:10 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:35:10 user nova-compute[75215]:       <entry name="serial">b372f84a-390e-4707-ad3c-8d9f0a7c8327</entry>
Nov 11 01:35:10 user nova-compute[75215]:       <entry name="uuid">b372f84a-390e-4707-ad3c-8d9f0a7c8327</entry>
Nov 11 01:35:10 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:35:10 user nova-compute[75215]:     </system>
Nov 11 01:35:10 user nova-compute[75215]:   </sysinfo>
Nov 11 01:35:10 user nova-compute[75215]:   <os>
Nov 11 01:35:10 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:35:10 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:35:10 user nova-compute[75215]:   </os>
Nov 11 01:35:10 user nova-compute[75215]:   <features>
Nov 11 01:35:10 user nova-compute[75215]:     <acpi/>
Nov 11 01:35:10 user nova-compute[75215]:     <apic/>
Nov 11 01:35:10 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:35:10 user nova-compute[75215]:   </features>
Nov 11 01:35:10 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:35:10 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:35:10 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:35:10 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:35:10 user nova-compute[75215]:   </clock>
Nov 11 01:35:10 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:35:10 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:35:10 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:35:10 user nova-compute[75215]:   </cpu>
Nov 11 01:35:10 user nova-compute[75215]:   <devices>
Nov 11 01:35:10 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:35:10 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:35:10 user nova-compute[75215]:       <source dev="/dev/sdh"/>
Nov 11 01:35:10 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:35:10 user nova-compute[75215]:       <serial>b5756be5-b549-4aa5-a440-62df68449e6a</serial>
Nov 11 01:35:10 user nova-compute[75215]:     </disk>
Nov 11 01:35:10 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:35:10 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:35:10 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue"/>
Nov 11 01:35:10 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:35:10 user nova-compute[75215]:       <boot order="1"/>
Nov 11 01:35:10 user nova-compute[75215]:     </disk>
Nov 11 01:35:10 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:35:10 user nova-compute[75215]:       <mac address="fa:16:3e:61:e5:81"/>
Nov 11 01:35:10 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:35:10 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:35:10 user nova-compute[75215]:       <target dev="tap427d21a8-09"/>
Nov 11 01:35:10 user nova-compute[75215]:     </interface>
Nov 11 01:35:10 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:35:10 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/console.log" append="off"/>
Nov 11 01:35:10 user nova-compute[75215]:     </serial>
Nov 11 01:35:10 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:35:10 user nova-compute[75215]:     <video>
Nov 11 01:35:10 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:35:10 user nova-compute[75215]:     </video>
Nov 11 01:35:10 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:35:10 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:35:10 user nova-compute[75215]:     </rng>
Nov 11 01:35:10 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:35:10 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:35:10 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:35:10 user nova-compute[75215]:     </memballoon>
Nov 11 01:35:10 user nova-compute[75215]:   </devices>
Nov 11 01:35:10 user nova-compute[75215]: </domain>
Nov 11 01:35:10 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:35:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance destroyed successfully.
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No VIF found with MAC fa:16:3e:61:e5:81, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:11 user nova-compute[75215]: INFO nova.compute.manager [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Attaching volume 7ab170cd-205e-489c-99c2-03f6a32873e7 to /dev/vdb
Nov 11 01:35:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de74cd4-c9ae-4936-95ab-61a497e61354]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[03413535-fbe1-41a6-9dfd-e371de84ef28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e0e70b-16b7-45c0-a47c-e02856a4b2e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd9ca38-20c8-4497-9999-3dbe80b6c8f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:35:11 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e2c871-5028-4a0c-adb8-e088318e35e9]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Updating existing volume attachment record: 821655be-8117-4140-99ef-a1f0ee14adab {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-68bd5d46-24d1-4bc3-bfe8-78e4e02435ec req-b2084d3b-a476-4438-bfdd-b221e3c81d00 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received event network-vif-deleted-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:11 user nova-compute[75215]: INFO nova.compute.manager [req-68bd5d46-24d1-4bc3-bfe8-78e4e02435ec req-b2084d3b-a476-4438-bfdd-b221e3c81d00 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Neutron deleted interface 9f846e49-33b9-4b5c-a170-258eeae8471f; detaching it from the instance and deleting it from the info cache
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.network.neutron [req-68bd5d46-24d1-4bc3-bfe8-78e4e02435ec req-b2084d3b-a476-4438-bfdd-b221e3c81d00 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-68bd5d46-24d1-4bc3-bfe8-78e4e02435ec req-b2084d3b-a476-4438-bfdd-b221e3c81d00 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Detach interface failed, port_id=9f846e49-33b9-4b5c-a170-258eeae8471f, reason: Instance a0456c90-8b61-44aa-9484-08d9a481f8a7 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:35:11 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Took 1.19 seconds to deallocate network for instance.
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received event network-vif-unplugged-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] No waiting events found dispatching network-vif-unplugged-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:11 user nova-compute[75215]: WARNING nova.compute.manager [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received unexpected event network-vif-unplugged-9f846e49-33b9-4b5c-a170-258eeae8471f for instance with vm_state deleted and task_state None.
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-changed-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Refreshing instance network info cache due to event network-changed-5e151329-5da5-4b43-a1d6-80c5fd4b9818. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Acquiring lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Acquired lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:35:11 user nova-compute[75215]: DEBUG nova.network.neutron [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Refreshing network info cache for port 5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Updated VIF entry in instance network info cache for port 5e151329-5da5-4b43-a1d6-80c5fd4b9818. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Updating instance_info_cache with network_info: [{"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Releasing lock "refresh_cache-5c815cf9-c1d2-496c-b4f3-190dcd19ab98" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received event network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Acquiring lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] No waiting events found dispatching network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:12 user nova-compute[75215]: WARNING nova.compute.manager [req-bb8b34f4-13ae-4917-8ad4-09f27eadfe29 req-45379cc6-6879-4456-a809-5ba0cc5fe1d1 service nova] [instance: a0456c90-8b61-44aa-9484-08d9a481f8a7] Received unexpected event network-vif-plugged-9f846e49-33b9-4b5c-a170-258eeae8471f for instance with vm_state deleted and task_state None.
Nov 11 01:35:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.916s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:12 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Deleted allocations for instance a0456c90-8b61-44aa-9484-08d9a481f8a7
Nov 11 01:35:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d36f622a-cf98-4ae5-8444-2a58ce1e6390 tempest-VolumesAssistedSnapshotsTest-1475212709 tempest-VolumesAssistedSnapshotsTest-1475212709-project-member] Lock "a0456c90-8b61-44aa-9484-08d9a481f8a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.532s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:13 user nova-compute[75215]: WARNING nova.compute.manager [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state active and task_state rescuing.
Nov 11 01:35:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:13 user nova-compute[75215]: WARNING nova.compute.manager [req-5352c0e4-2a75-44d1-a39c-d4e9c9e6dc25 req-1693acbe-b8cb-49b1-9e7f-75e62bf02223 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state active and task_state rescuing.
Nov 11 01:35:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-aa6462ba-23d6-43d3-8b74-df35673eb3fb tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:35:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdk (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:35:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:35:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7702MB free_disk=25.476181030273438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b7244d96-4c01-4a87-b76c-d76ba83e3879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 891f58ec-3924-4c75-b9cd-08d7f1f0f242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 01:35:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 01:35:21 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:35:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:35:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:35:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.917s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 01:35:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:35:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:35:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:35:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updating instance_info_cache with network_info: [{"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-b58b0c19-8c8a-482b-a693-eb6855ed5dd1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:35:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:35:43 user nova-compute[75215]: WARNING nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 330defc6-9b43-4f1e-9a76-94b23750e1b0 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 29f1747f-8209-4d8f-9929-d6227763b5c5 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid ad403c50-a8fe-442f-9189-0a6925580739 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid b58b0c19-8c8a-482b-a693-eb6855ed5dd1 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid b7244d96-4c01-4a87-b76c-d76ba83e3879 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 891f58ec-3924-4c75-b9cd-08d7f1f0f242 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid ed9354d9-106b-4ca5-8f60-0140c85e74ca {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ad403c50-a8fe-442f-9189-0a6925580739" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: INFO nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ad403c50-a8fe-442f-9189-0a6925580739" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.155s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:43 user nova-compute[75215]: WARNING nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Instance is unexpectedly not found. Ignore.
Nov 11 01:35:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.202s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmYkatCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:44 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:44 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:44 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cd0864-b971-4cb5-9574-062420f5426d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:35:44 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e269fd1-c23d-4275-8c48-060e7d628bae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7] added
Nov 11 01:35:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5d57bb-4f89-485e-9fff-ce2a014b68e2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35c1a18-d0e4-43f7-843f-505387597af8]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmYkatCN {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmYkatCN" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0601b151-0017-4257-abd6-38830ffe044d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmYkatCN'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48a0a7e-bd55-47ee-97c3-84eb6184e8e6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b44500b-054c-4ade-a463-73bf85633169]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8359f380-a636-4098-875d-eef63df621e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260]
Nov 11 01:35:44 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260] successful.
Nov 11 01:35:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38fabf9-2931-46f6-9660-cc8095a86801]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7c2f36-a7e7-4b50-b864-205390681227]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfda8127-10e4-44c9-af2e-3ed024f158c1]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:35:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:35:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmYkatCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:35:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23237323466396633', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237323466396633', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:35:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'flavor' on Instance uuid 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:35:45 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:35:45 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:35:45 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:35:45 user nova-compute[75215]:   <serial>7ab170cd-205e-489c-99c2-03f6a32873e7</serial>
Nov 11 01:35:45 user nova-compute[75215]: </disk>
Nov 11 01:35:45 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:35:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:35:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:35:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No VIF found with MAC fa:16:3e:57:cb:70, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:35:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-effcabfa-675a-40a3-a107-893743ebce7b tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.182s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.584s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-cbfd73ef-7fb5-40a1-91b0-2c0bfe078b11 req-dc37fc96-8d3c-487a-b6f7-271499819004 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-changed-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-cbfd73ef-7fb5-40a1-91b0-2c0bfe078b11 req-dc37fc96-8d3c-487a-b6f7-271499819004 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing instance network info cache due to event network-changed-7398a138-4e55-4f66-bbb4-15b5984ca9b1. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cbfd73ef-7fb5-40a1-91b0-2c0bfe078b11 req-dc37fc96-8d3c-487a-b6f7-271499819004 service nova] Acquiring lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cbfd73ef-7fb5-40a1-91b0-2c0bfe078b11 req-dc37fc96-8d3c-487a-b6f7-271499819004 service nova] Acquired lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-cbfd73ef-7fb5-40a1-91b0-2c0bfe078b11 req-dc37fc96-8d3c-487a-b6f7-271499819004 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Refreshing network info cache for port 7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:35:47 user nova-compute[75215]: INFO nova.compute.manager [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Rebuilding instance
Nov 11 01:35:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-7749618e-d313-4456-80bd-481fc60edf17 req-b676ceef-c7a5-4d28-974a-b04bdc7e7500 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-unplugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7749618e-d313-4456-80bd-481fc60edf17 req-b676ceef-c7a5-4d28-974a-b04bdc7e7500 service nova] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7749618e-d313-4456-80bd-481fc60edf17 req-b676ceef-c7a5-4d28-974a-b04bdc7e7500 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7749618e-d313-4456-80bd-481fc60edf17 req-b676ceef-c7a5-4d28-974a-b04bdc7e7500 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-7749618e-d313-4456-80bd-481fc60edf17 req-b676ceef-c7a5-4d28-974a-b04bdc7e7500 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] No waiting events found dispatching network-vif-unplugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:47 user nova-compute[75215]: WARNING nova.compute.manager [req-7749618e-d313-4456-80bd-481fc60edf17 req-b676ceef-c7a5-4d28-974a-b04bdc7e7500 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received unexpected event network-vif-unplugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 for instance with vm_state active and task_state rebuilding.
Nov 11 01:35:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-cbfd73ef-7fb5-40a1-91b0-2c0bfe078b11 req-dc37fc96-8d3c-487a-b6f7-271499819004 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updated VIF entry in instance network info cache for port 7398a138-4e55-4f66-bbb4-15b5984ca9b1. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-cbfd73ef-7fb5-40a1-91b0-2c0bfe078b11 req-dc37fc96-8d3c-487a-b6f7-271499819004 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [{"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cbfd73ef-7fb5-40a1-91b0-2c0bfe078b11 req-dc37fc96-8d3c-487a-b6f7-271499819004 service nova] Releasing lock "refresh_cache-b7244d96-4c01-4a87-b76c-d76ba83e3879" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance destroyed successfully.
Nov 11 01:35:48 user nova-compute[75215]: INFO nova.compute.manager [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Detaching volume 7ab170cd-205e-489c-99c2-03f6a32873e7
Nov 11 01:35:48 user nova-compute[75215]: INFO nova.virt.block_device [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Attempting to driver detach volume 7ab170cd-205e-489c-99c2-03f6a32873e7 from mountpoint /dev/vdb
Nov 11 01:35:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Attempting to detach device vdb from instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:35:48 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:35:48 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:35:48 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:35:48 user nova-compute[75215]:   <serial>7ab170cd-205e-489c-99c2-03f6a32873e7</serial>
Nov 11 01:35:48 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:35:48 user nova-compute[75215]: </disk>
Nov 11 01:35:48 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:35:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully detached device vdb from instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 from the persistent domain config.
Nov 11 01:35:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmYkatCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:48 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[360af6a4-a15b-4db7-bb54-f324dcad6b11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:35:48 user nova-compute[75215]: No targets found.
Nov 11 01:35:48 user nova-compute[75215]: iSNS:
Nov 11 01:35:48 user nova-compute[75215]: No targets found.
Nov 11 01:35:48 user nova-compute[75215]: STATIC:
Nov 11 01:35:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:35:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:48 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:35:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:48 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:35:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:48 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d
Nov 11 01:35:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:48 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:35:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:48 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:35:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:48 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:48 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7
Nov 11 01:35:48 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:48 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:48 user nova-compute[75215]: FIRMWARE:
Nov 11 01:35:48 user nova-compute[75215]: No targets found.
Nov 11 01:35:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:35:48 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:35:48 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f951b6ee-787d-4fae-8260-8f3041567c8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7378d-44e0-4e48-9a08-169c714609e3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:35:48 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404421cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2578ef07-cf7d-4e0d-847c-e672ebec6191]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc85a7ae-ed96-4205-9404-5e044ef057bd]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8804cbe0-c19d-42cf-9068-8da5c25c5d8d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b838d0e-02a0-47ac-9965-965ddf59add5]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7612f331-5a69-4369-919b-43057aa2ae60]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8735c1-a817-4caa-8b10-0c96f9ed45fd]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260]
Nov 11 01:35:48 user nova-compute[75215]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260] successful.
Nov 11 01:35:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a637d20e-4d0d-480d-95ab-999d7897d5ff]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== disconnect_volume: return (326ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:35:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance destroyed successfully.
Nov 11 01:35:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1329016254',display_name='tempest-ServerActionsTestOtherA-server-1084493935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1329016254',id=14,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVPN5anh2XXeiivIGiHtn+WBt+rHOSMg3zh/uez0YkfrvS0adQ5fDROJuNHEVqbieRXHJf3+6tvz110BkRBpXfWJYP78Rb9BHIjC6wlzax3PwmZN+kJ+N61Edfk/zphA==',key_name='tempest-keypair-1076303283',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:33:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-fqo3dwe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=5c815cf9-c1d2-496c-b4f3-190dcd19ab98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG os_vif [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e151329-5d, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=049e966d-6c6f-4a3c-a103-ffc6f7f3bb0f) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:49 user nova-compute[75215]: INFO os_vif [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d')
Nov 11 01:35:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmYkatCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 01:35:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94ce45-cd7a-4254-8ca5-d6df8a5375d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:35:49 user nova-compute[75215]: No targets found.
Nov 11 01:35:49 user nova-compute[75215]: iSNS:
Nov 11 01:35:49 user nova-compute[75215]: No targets found.
Nov 11 01:35:49 user nova-compute[75215]: STATIC:
Nov 11 01:35:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:35:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:49 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:35:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:49 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:35:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:49 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d
Nov 11 01:35:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:49 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:35:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:49 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:35:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:49 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:49 user nova-compute[75215]: FIRMWARE:
Nov 11 01:35:49 user nova-compute[75215]: No targets found.
Nov 11 01:35:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:35:49 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:35:49 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-865a99df-d238-4b81-b0a7-3bb4031e1e7c req-586fb6a1-a63f-4978-9786-b0749ed22679 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-865a99df-d238-4b81-b0a7-3bb4031e1e7c req-586fb6a1-a63f-4978-9786-b0749ed22679 service nova] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-865a99df-d238-4b81-b0a7-3bb4031e1e7c req-586fb6a1-a63f-4978-9786-b0749ed22679 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-865a99df-d238-4b81-b0a7-3bb4031e1e7c req-586fb6a1-a63f-4978-9786-b0749ed22679 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-865a99df-d238-4b81-b0a7-3bb4031e1e7c req-586fb6a1-a63f-4978-9786-b0749ed22679 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] No waiting events found dispatching network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:49 user nova-compute[75215]: WARNING nova.compute.manager [req-865a99df-d238-4b81-b0a7-3bb4031e1e7c req-586fb6a1-a63f-4978-9786-b0749ed22679 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received unexpected event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 for instance with vm_state active and task_state rebuilding.
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d90046-f9f8-46bb-ac25-c3bb549420fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[796098cb-f646-497e-b27d-65ff06aa91e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:50 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:50 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:50 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40444f2a70>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.098s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== disconnect_volume: return (99ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:35:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Deleting instance files /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98_del
Nov 11 01:35:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Deletion of /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98_del complete
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:50 user nova-compute[75215]: INFO nova.compute.manager [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Terminating instance
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:35:50 user nova-compute[75215]: INFO nova.virt.block_device [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Booting with volume 7ab170cd-205e-489c-99c2-03f6a32873e7 at /dev/vdb
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.utils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2270b9-c582-4917-82bc-3af2bd6defa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4204da-57e0-4096-a6af-f8fb95f381f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[911583a5-c4b7-4ddd-981e-c31e49f7be87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[05029785-5a38-487a-aa5c-2b6b46875c72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:35:50 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ed25bc-cbd7-4856-84dc-492a9efd1312]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG os_brick.utils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Updating existing volume attachment record: 24775e48-84fa-4f81-ad11-d76b1d6b9d29 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0f6f530-e6fe-4c65-9537-79a00cc87480 req-69fa690c-4e70-49d9-90df-294c91a46deb service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0f6f530-e6fe-4c65-9537-79a00cc87480 req-69fa690c-4e70-49d9-90df-294c91a46deb service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0f6f530-e6fe-4c65-9537-79a00cc87480 req-69fa690c-4e70-49d9-90df-294c91a46deb service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0f6f530-e6fe-4c65-9537-79a00cc87480 req-69fa690c-4e70-49d9-90df-294c91a46deb service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0f6f530-e6fe-4c65-9537-79a00cc87480 req-69fa690c-4e70-49d9-90df-294c91a46deb service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-unplugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0f6f530-e6fe-4c65-9537-79a00cc87480 req-69fa690c-4e70-49d9-90df-294c91a46deb service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ebed7484-875b-4f02-b177-5d62602091cc req-bd906cf6-da7f-4c55-968b-63bdb43b1d7c service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ebed7484-875b-4f02-b177-5d62602091cc req-bd906cf6-da7f-4c55-968b-63bdb43b1d7c service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ebed7484-875b-4f02-b177-5d62602091cc req-bd906cf6-da7f-4c55-968b-63bdb43b1d7c service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ebed7484-875b-4f02-b177-5d62602091cc req-bd906cf6-da7f-4c55-968b-63bdb43b1d7c service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ebed7484-875b-4f02-b177-5d62602091cc req-bd906cf6-da7f-4c55-968b-63bdb43b1d7c service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-unplugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ebed7484-875b-4f02-b177-5d62602091cc req-bd906cf6-da7f-4c55-968b-63bdb43b1d7c service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Instance destroyed successfully.
Nov 11 01:35:51 user nova-compute[75215]: DEBUG nova.objects.instance [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lazy-loading 'resources' on Instance uuid b7244d96-4c01-4a87-b76c-d76ba83e3879 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "address": "fa:16:3e:86:88:3a", "network": {"id": "8956f526-fecc-4a78-9e49-ee3c054508a7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1168817431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7398a138-4e", "ovs_interfaceid": "7398a138-4e55-4f66-bbb4-15b5984ca9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:88:3a,bridge_name='br-int',has_traffic_filtering=True,id=7398a138-4e55-4f66-bbb4-15b5984ca9b1,network=Network(8956f526-fecc-4a78-9e49-ee3c054508a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7398a138-4e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:88:3a,bridge_name='br-int',has_traffic_filtering=True,id=7398a138-4e55-4f66-bbb4-15b5984ca9b1,network=Network(8956f526-fecc-4a78-9e49-ee3c054508a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7398a138-4e') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7398a138-4e, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=608721eb-f432-446d-a7e0-9d002ff8c1b2) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-unplugged-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-12ef6d6e-de92-484c-b739-c6b996a087fa for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-12ef6d6e-de92-484c-b739-c6b996a087fa for instance with vm_state active and task_state deleting.
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-unplugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING nova.compute.manager [req-59d6ccb6-aabc-49a4-b29a-22bf4cd335d3 req-7b31ce11-0b40-4659-b1ab-666ff41abbed service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-4ca5faf6-ab9d-4681-8990-c6a44198dda5 for instance with vm_state active and task_state deleting.
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: INFO os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:88:3a,bridge_name='br-int',has_traffic_filtering=True,id=7398a138-4e55-4f66-bbb4-15b5984ca9b1,network=Network(8956f526-fecc-4a78-9e49-ee3c054508a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7398a138-4e')
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d9:60,bridge_name='br-int',has_traffic_filtering=True,id=b026352a-77fc-4695-a7f2-1b5ee72c9bcc,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb026352a-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d9:60,bridge_name='br-int',has_traffic_filtering=True,id=b026352a-77fc-4695-a7f2-1b5ee72c9bcc,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb026352a-77') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb026352a-77, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ec230f8-9603-4a10-abec-4309f78a82ff) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: INFO os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d9:60,bridge_name='br-int',has_traffic_filtering=True,id=b026352a-77fc-4695-a7f2-1b5ee72c9bcc,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb026352a-77')
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:26:4c,bridge_name='br-int',has_traffic_filtering=True,id=12ef6d6e-de92-484c-b739-c6b996a087fa,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12ef6d6e-de') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:26:4c,bridge_name='br-int',has_traffic_filtering=True,id=12ef6d6e-de92-484c-b739-c6b996a087fa,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12ef6d6e-de') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12ef6d6e-de, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58f44af3-29b7-48b5-81dc-023603c04f35) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: INFO os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:26:4c,bridge_name='br-int',has_traffic_filtering=True,id=12ef6d6e-de92-484c-b739-c6b996a087fa,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12ef6d6e-de')
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:3f,bridge_name='br-int',has_traffic_filtering=True,id=142fc2a0-8b74-459d-a5ae-caa1ecfd5745,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142fc2a0-8b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:3f,bridge_name='br-int',has_traffic_filtering=True,id=142fc2a0-8b74-459d-a5ae-caa1ecfd5745,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142fc2a0-8b') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap142fc2a0-8b, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=681a00d7-744b-45d8-abfd-21e1a3bf8dd2) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: INFO os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:3f,bridge_name='br-int',has_traffic_filtering=True,id=142fc2a0-8b74-459d-a5ae-caa1ecfd5745,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142fc2a0-8b')
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:d6,bridge_name='br-int',has_traffic_filtering=True,id=ebbeba2a-d881-4978-afae-3b5942328ed0,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbeba2a-d8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:d6,bridge_name='br-int',has_traffic_filtering=True,id=ebbeba2a-d881-4978-afae-3b5942328ed0,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbeba2a-d8') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebbeba2a-d8, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e70eb178-9b66-45c8-8d19-72a793e99744) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: INFO os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:d6,bridge_name='br-int',has_traffic_filtering=True,id=ebbeba2a-d881-4978-afae-3b5942328ed0,network=Network(c11a5a0d-e3bd-4c5c-879a-97fab990ae2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbeba2a-d8')
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:68:43,bridge_name='br-int',has_traffic_filtering=True,id=4218d5db-bda9-4828-83b3-bb481228ad92,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4218d5db-bd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:68:43,bridge_name='br-int',has_traffic_filtering=True,id=4218d5db-bda9-4828-83b3-bb481228ad92,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4218d5db-bd') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4218d5db-bd, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8761a0b8-c674-4372-af28-c05bd58868c4) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: INFO os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:68:43,bridge_name='br-int',has_traffic_filtering=True,id=4218d5db-bda9-4828-83b3-bb481228ad92,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4218d5db-bd')
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1146317401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1146317401',id=12,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdo7C0ANLKo9wf3jqbN/8iCY27n6m0JWkCpeDmdjlWrIEpIKvXxuvLBWaHTk6Ak/J3hGp+pdMyZ3FwOhrwgE7ntbjMoFcUlCu/S93+Zapptwi6n8h6EL5bByUqeHvFLZw==',key_name='tempest-keypair-1573071289',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d06db6e47a408d958c8ac0028856ec',ramdisk_id='',reservation_id='r-316umv7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248833589',owner_user_name='tempest-TaggedBootDevicesTest-1248833589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4aa36891e1164546994ea1a2308fab65',uuid=b7244d96-4c01-4a87-b76c-d76ba83e3879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converting VIF {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:33:66,bridge_name='br-int',has_traffic_filtering=True,id=4ca5faf6-ab9d-4681-8990-c6a44198dda5,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca5faf6-ab') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:33:66,bridge_name='br-int',has_traffic_filtering=True,id=4ca5faf6-ab9d-4681-8990-c6a44198dda5,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca5faf6-ab') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ca5faf6-ab, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b63c0f55-f1fb-4067-8b86-5874addddb96) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:52 user nova-compute[75215]: INFO os_vif [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:33:66,bridge_name='br-int',has_traffic_filtering=True,id=4ca5faf6-ab9d-4681-8990-c6a44198dda5,network=Network(6e403de8-6766-494b-90bd-36e725001d67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca5faf6-ab')
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lukYebWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-7398a138-4e55-4f66-bbb4-15b5984ca9b1 for instance with vm_state active and task_state deleting.
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-unplugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 for instance with vm_state active and task_state deleting.
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-unplugged-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-ebbeba2a-d881-4978-afae-3b5942328ed0 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-ebbeba2a-d881-4978-afae-3b5942328ed0 for instance with vm_state active and task_state deleting.
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-unplugged-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-unplugged-4218d5db-bda9-4828-83b3-bb481228ad92 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING nova.compute.manager [req-19085102-b12c-4b5d-8e51-cef2a575b616 req-811190f9-e7fe-4c73-8c7c-cc0591c17cbe service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-4218d5db-bda9-4828-83b3-bb481228ad92 for instance with vm_state active and task_state deleting.
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc737e-792a-48fc-82cf-e15f0d77934a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:35:52 user nova-compute[75215]: No targets found.
Nov 11 01:35:52 user nova-compute[75215]: iSNS:
Nov 11 01:35:52 user nova-compute[75215]: No targets found.
Nov 11 01:35:52 user nova-compute[75215]: STATIC:
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: FIRMWARE:
Nov 11 01:35:52 user nova-compute[75215]: No targets found.
Nov 11 01:35:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:35:52 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:35:52 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78e39a1-3869-4473-8c86-089ddb13cc76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec34311-1796-4e24-97cc-865eabc7a1fe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40644cb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d'): ({'sdi'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Removing single pathed devices sdi {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69e4db9-3830-43b5-a603-e481858bc759]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda8630-b798-4504-a3da-84de22d98679]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Flushing IO for device /dev/sdi {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddd6f2a-e153-4e4b-baa1-d2146aa6c427]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-359d713e-ac68-4997-b927-decc2d92248a req-9cc5aae0-a34c-480f-ad3a-2f135b73fff2 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-359d713e-ac68-4997-b927-decc2d92248a req-9cc5aae0-a34c-480f-ad3a-2f135b73fff2 service nova] Acquiring lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-359d713e-ac68-4997-b927-decc2d92248a req-9cc5aae0-a34c-480f-ad3a-2f135b73fff2 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-359d713e-ac68-4997-b927-decc2d92248a req-9cc5aae0-a34c-480f-ad3a-2f135b73fff2 service nova] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-359d713e-ac68-4997-b927-decc2d92248a req-9cc5aae0-a34c-480f-ad3a-2f135b73fff2 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] No waiting events found dispatching network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING nova.compute.manager [req-359d713e-ac68-4997-b927-decc2d92248a req-9cc5aae0-a34c-480f-ad3a-2f135b73fff2 service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received unexpected event network-vif-plugged-b026352a-77fc-4695-a7f2-1b5ee72c9bcc for instance with vm_state active and task_state deleting.
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[29880b92-8b42-40de-930c-a769e299c9ed]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] SCSI volumes sdi have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8aceb4-96a6-4ab0-92c2-42a28c1e0705]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bc76f7-b932-43ed-8770-eb9a15e4af88]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d, portal: 172.16.0.220,3260]
Nov 11 01:35:52 user nova-compute[75215]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d, portal: 172.16.0.220,3260] successful.
Nov 11 01:35:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e92bcae-2617-4d3c-b7fe-f25bf3a73a3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd765e6-6f86-4685-a972-c723765227fc]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== disconnect_volume: return (335ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNEJQCOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:52 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa7976-4882-4c66-9227-171ab7bf5e5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:35:52 user nova-compute[75215]: No targets found.
Nov 11 01:35:52 user nova-compute[75215]: iSNS:
Nov 11 01:35:52 user nova-compute[75215]: No targets found.
Nov 11 01:35:52 user nova-compute[75215]: STATIC:
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:35:52 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:52 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:52 user nova-compute[75215]: FIRMWARE:
Nov 11 01:35:52 user nova-compute[75215]: No targets found.
Nov 11 01:35:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:35:52 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:35:52 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a410e685-843c-40a7-8bc4-4379fa2af7dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8109adcb-fd46-4995-8b3a-7c28d0d94442]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:52 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40644cb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f'): ({'sdj'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Removing single pathed devices sdj {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aca565-1f40-46e3-8a03-51518269b968]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef87825d-0fc2-44c7-a815-26836af548e8]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Flushing IO for device /dev/sdj {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3304502-a981-490f-a82b-d7f90854c177]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[78128791-0649-4876-870b-d7f205f60d27]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] SCSI volumes sdj have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbccedf-2fce-4c7a-ae23-6cfaaa8738ab]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a1861-5b4f-475c-94c8-bb853c9dd894]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f, portal: 172.16.0.220,3260]
Nov 11 01:35:53 user nova-compute[75215]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f, portal: 172.16.0.220,3260] successful.
Nov 11 01:35:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215d826c-552a-4d8e-a079-2cab7f94d56f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d3b202-84aa-483c-8fe6-8d056bacb4dd]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== disconnect_volume: return (364ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkluSQhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:35:53 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7774a323-388a-4574-b3d0-4d9582b7761c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:35:53 user nova-compute[75215]: No targets found.
Nov 11 01:35:53 user nova-compute[75215]: iSNS:
Nov 11 01:35:53 user nova-compute[75215]: No targets found.
Nov 11 01:35:53 user nova-compute[75215]: STATIC:
Nov 11 01:35:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df
Nov 11 01:35:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:53 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:35:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:53 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:35:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:53 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:35:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:35:53 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:35:53 user nova-compute[75215]: FIRMWARE:
Nov 11 01:35:53 user nova-compute[75215]: No targets found.
Nov 11 01:35:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:35:53 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:35:53 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6d2718-e4f7-4a6c-bd03-89d65e310171]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5822c831-b710-47f1-bdb1-a8e756e09425]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:53 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:53 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:53 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:35:53 user nova-compute[75215]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df (non-flash)
Nov 11 01:35:53 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:35:53 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:35:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40644cb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df'): ({'sdk'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Removing single pathed devices sdk {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b9627b-7d8d-42cb-8968-32d25f2d95c1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d3eac-e9f2-49aa-8705-232cf4ce86c1]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Flushing IO for device /dev/sdk {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc815ec2-2c7a-418f-adb0-49d0df142db2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.040s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe24a9bc-77f5-46ec-8bbb-196ed7ba37cb]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] SCSI volumes sdk have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbac440f-14f2-44f7-8057-6ad8c132a73c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[18523b20-9ea4-41ea-aad1-e194cb308856]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df, portal: 172.16.0.220,3260]
Nov 11 01:35:53 user nova-compute[75215]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df, portal: 172.16.0.220,3260] successful.
Nov 11 01:35:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44f2dc55-c51f-4c57-9875-308d3a0545df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe5a1f-437c-4685-baae-2cb764723a5d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] <== disconnect_volume: return (322ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:35:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Deleting instance files /opt/stack/data/nova/instances/b7244d96-4c01-4a87-b76c-d76ba83e3879_del
Nov 11 01:35:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Deletion of /opt/stack/data/nova/instances/b7244d96-4c01-4a87-b76c-d76ba83e3879_del complete
Nov 11 01:35:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:53 user nova-compute[75215]: INFO nova.compute.manager [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Took 3.81 seconds to destroy the instance on the hypervisor.
Nov 11 01:35:53 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:35:53 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:35:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-2e045d1a-5eae-40d0-9643-1f99d1a0185e req-5d307548-1526-400c-996a-78b9c717c30a service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-deleted-7398a138-4e55-4f66-bbb4-15b5984ca9b1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:55 user nova-compute[75215]: INFO nova.compute.manager [req-2e045d1a-5eae-40d0-9643-1f99d1a0185e req-5d307548-1526-400c-996a-78b9c717c30a service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Neutron deleted interface 7398a138-4e55-4f66-bbb4-15b5984ca9b1; detaching it from the instance and deleting it from the info cache
Nov 11 01:35:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-2e045d1a-5eae-40d0-9643-1f99d1a0185e req-5d307548-1526-400c-996a-78b9c717c30a service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [{"id": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "address": "fa:16:3e:dd:d9:60", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb026352a-77", "ovs_interfaceid": "b026352a-77fc-4695-a7f2-1b5ee72c9bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12ef6d6e-de92-484c-b739-c6b996a087fa", "address": "fa:16:3e:6b:26:4c", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ef6d6e-de", "ovs_interfaceid": "12ef6d6e-de92-484c-b739-c6b996a087fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "address": "fa:16:3e:87:98:3f", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142fc2a0-8b", "ovs_interfaceid": "142fc2a0-8b74-459d-a5ae-caa1ecfd5745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebbeba2a-d881-4978-afae-3b5942328ed0", "address": "fa:16:3e:e0:21:d6", "network": {"id": "c11a5a0d-e3bd-4c5c-879a-97fab990ae2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1023863846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbeba2a-d8", "ovs_interfaceid": "ebbeba2a-d881-4978-afae-3b5942328ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4218d5db-bda9-4828-83b3-bb481228ad92", "address": "fa:16:3e:bd:68:43", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4218d5db-bd", "ovs_interfaceid": "4218d5db-bda9-4828-83b3-bb481228ad92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "address": "fa:16:3e:24:33:66", "network": {"id": "6e403de8-6766-494b-90bd-36e725001d67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1469163705", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d06db6e47a408d958c8ac0028856ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca5faf6-ab", "ovs_interfaceid": "4ca5faf6-ab9d-4681-8990-c6a44198dda5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-2e045d1a-5eae-40d0-9643-1f99d1a0185e req-5d307548-1526-400c-996a-78b9c717c30a service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Detach interface failed, port_id=7398a138-4e55-4f66-bbb4-15b5984ca9b1, reason: Instance b7244d96-4c01-4a87-b76c-d76ba83e3879 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:35:57 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:35:57 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Took 3.63 seconds to deallocate network for instance.
Nov 11 01:35:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:35:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b2724a4d-0b41-4db7-bebb-9cd8b52fc654 req-2acf4cb2-6c3a-419c-9b29-1a44cb9672ae service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-deleted-142fc2a0-8b74-459d-a5ae-caa1ecfd5745 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b2724a4d-0b41-4db7-bebb-9cd8b52fc654 req-2acf4cb2-6c3a-419c-9b29-1a44cb9672ae service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-deleted-ebbeba2a-d881-4978-afae-3b5942328ed0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b2724a4d-0b41-4db7-bebb-9cd8b52fc654 req-2acf4cb2-6c3a-419c-9b29-1a44cb9672ae service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-deleted-4218d5db-bda9-4828-83b3-bb481228ad92 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-b2724a4d-0b41-4db7-bebb-9cd8b52fc654 req-2acf4cb2-6c3a-419c-9b29-1a44cb9672ae service nova] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Received event network-vif-deleted-4ca5faf6-ab9d-4681-8990-c6a44198dda5 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:35:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:12 user nova-compute[75215]: INFO nova.compute.manager [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] [instance: b7244d96-4c01-4a87-b76c-d76ba83e3879] Took 14.82 seconds to detach 3 volumes for instance.
Nov 11 01:36:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.376s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:12 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:36:12 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Deleted allocations for instance b7244d96-4c01-4a87-b76c-d76ba83e3879
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-eb75d71a-43e1-41c2-a1ff-fb993b1c2d97 tempest-TaggedBootDevicesTest-1248833589 tempest-TaggedBootDevicesTest-1248833589-project-member] Lock "b7244d96-4c01-4a87-b76c-d76ba83e3879" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.929s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:36:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:36:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:36:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:36:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.48904037475586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 891f58ec-3924-4c75-b9cd-08d7f1f0f242 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:36:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:17 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:36:17 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:36:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:36:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:36:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:36:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:36:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:36:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:36:18 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 330defc6-9b43-4f1e-9a76-94b23750e1b0 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:36:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updating instance_info_cache with network_info: [{"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:36:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:36:23 user nova-compute[75215]: INFO nova.compute.claims [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Claim successful on node user
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:36:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:36:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:36:23 user nova-compute[75215]: DEBUG nova.policy [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11c0895e92ca4572b6f004d360f18eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739153e36b674c839c8d7bb97201e4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:36:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Creating image(s)
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk 1073741824" returned: 0 in 0.062s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Successfully created port: c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Cannot resize image /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Ensure instance console log exists: /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:36:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Creating image(s)
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Successfully updated port: c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquired lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-19c0cf20-476b-42ff-8fd7-969a359fdc61 req-048e9356-d30e-412e-86dc-133fa4aca17a service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-changed-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-19c0cf20-476b-42ff-8fd7-969a359fdc61 req-048e9356-d30e-412e-86dc-133fa4aca17a service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Refreshing instance network info cache due to event network-changed-c546474a-e342-4eee-8398-789477c6a76d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19c0cf20-476b-42ff-8fd7-969a359fdc61 req-048e9356-d30e-412e-86dc-133fa4aca17a service nova] Acquiring lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk 1073741824" returned: 0 in 0.054s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Releasing lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance network_info: |[{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19c0cf20-476b-42ff-8fd7-969a359fdc61 req-048e9356-d30e-412e-86dc-133fa4aca17a service nova] Acquired lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-19c0cf20-476b-42ff-8fd7-969a359fdc61 req-048e9356-d30e-412e-86dc-133fa4aca17a service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Refreshing network info cache for port c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:36:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Start _get_guest_xml network_info=[{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:36:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:36:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-50013957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-50013957',id=16,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQho/bCGrdZjcyqN99hrRAj160xs5F2vrlEMeo4CuZhGRjtH+zSm55GqZ4SsRaTZmKJMk/2U6gXbQDYUX/BJ4mNp2SiIyVFBV9BEnjC2HItbMPv+SwGDbBUux0PjTK0Uw==',key_name='tempest-keypair-118414557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-fj250k7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=c26d1d9c-4086-4d2a-9551-b1c4b388b0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'pci_devices' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Cannot resize image /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Ensure instance console log exists: /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Start _get_guest_xml network_info=[{"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '24775e48-84fa-4f81-ad11-d76b1d6b9d29', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmYkatCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c815cf9-c1d2-496c-b4f3-190dcd19ab98', 'attached_at': '', 'detached_at': '', 'volume_id': '7ab170cd-205e-489c-99c2-03f6a32873e7', 'serial': '7ab170cd-205e-489c-99c2-03f6a32873e7'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:36:26 user nova-compute[75215]:   <uuid>c26d1d9c-4086-4d2a-9551-b1c4b388b0ea</uuid>
Nov 11 01:36:26 user nova-compute[75215]:   <name>instance-00000010</name>
Nov 11 01:36:26 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:36:26 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:36:26 user nova-compute[75215]:   <metadata>
Nov 11 01:36:26 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:36:26 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:36:26 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-50013957</nova:name>
Nov 11 01:36:26 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:36:26</nova:creationTime>
Nov 11 01:36:26 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:36:26 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:36:26 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:36:26 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:36:26 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:36:26 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:36:26 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:36:26 user nova-compute[75215]:       <nova:owner>
Nov 11 01:36:26 user nova-compute[75215]:         <nova:user uuid="11c0895e92ca4572b6f004d360f18eaf">tempest-AttachVolumeShelveTestJSON-1029212070-project-member</nova:user>
Nov 11 01:36:26 user nova-compute[75215]:         <nova:project uuid="739153e36b674c839c8d7bb97201e4aa">tempest-AttachVolumeShelveTestJSON-1029212070</nova:project>
Nov 11 01:36:26 user nova-compute[75215]:       </nova:owner>
Nov 11 01:36:26 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:36:26 user nova-compute[75215]:       <nova:ports>
Nov 11 01:36:26 user nova-compute[75215]:         <nova:port uuid="c546474a-e342-4eee-8398-789477c6a76d">
Nov 11 01:36:26 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:36:26 user nova-compute[75215]:         </nova:port>
Nov 11 01:36:26 user nova-compute[75215]:       </nova:ports>
Nov 11 01:36:26 user nova-compute[75215]:     </nova:instance>
Nov 11 01:36:26 user nova-compute[75215]:   </metadata>
Nov 11 01:36:26 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:36:26 user nova-compute[75215]:     <system>
Nov 11 01:36:26 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:36:26 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:36:26 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:36:26 user nova-compute[75215]:       <entry name="serial">c26d1d9c-4086-4d2a-9551-b1c4b388b0ea</entry>
Nov 11 01:36:26 user nova-compute[75215]:       <entry name="uuid">c26d1d9c-4086-4d2a-9551-b1c4b388b0ea</entry>
Nov 11 01:36:26 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:36:26 user nova-compute[75215]:     </system>
Nov 11 01:36:26 user nova-compute[75215]:   </sysinfo>
Nov 11 01:36:26 user nova-compute[75215]:   <os>
Nov 11 01:36:26 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:36:26 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:36:26 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:36:26 user nova-compute[75215]:   </os>
Nov 11 01:36:26 user nova-compute[75215]:   <features>
Nov 11 01:36:26 user nova-compute[75215]:     <acpi/>
Nov 11 01:36:26 user nova-compute[75215]:     <apic/>
Nov 11 01:36:26 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:36:26 user nova-compute[75215]:   </features>
Nov 11 01:36:26 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:36:26 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:36:26 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:36:26 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:36:26 user nova-compute[75215]:   </clock>
Nov 11 01:36:26 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:36:26 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:36:26 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:36:26 user nova-compute[75215]:   </cpu>
Nov 11 01:36:26 user nova-compute[75215]:   <devices>
Nov 11 01:36:26 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:36:26 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:36:26 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk"/>
Nov 11 01:36:26 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:36:26 user nova-compute[75215]:     </disk>
Nov 11 01:36:26 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:36:26 user nova-compute[75215]:       <mac address="fa:16:3e:2a:54:ac"/>
Nov 11 01:36:26 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:36:26 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:36:26 user nova-compute[75215]:       <target dev="tapc546474a-e3"/>
Nov 11 01:36:26 user nova-compute[75215]:     </interface>
Nov 11 01:36:26 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:36:26 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/console.log" append="off"/>
Nov 11 01:36:26 user nova-compute[75215]:     </serial>
Nov 11 01:36:26 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:36:26 user nova-compute[75215]:     <video>
Nov 11 01:36:26 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:36:26 user nova-compute[75215]:     </video>
Nov 11 01:36:26 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:36:26 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:36:26 user nova-compute[75215]:     </rng>
Nov 11 01:36:26 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:36:26 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:36:26 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:36:26 user nova-compute[75215]:     </memballoon>
Nov 11 01:36:26 user nova-compute[75215]:   </devices>
Nov 11 01:36:26 user nova-compute[75215]: </domain>
Nov 11 01:36:26 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-50013957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-50013957',id=16,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQho/bCGrdZjcyqN99hrRAj160xs5F2vrlEMeo4CuZhGRjtH+zSm55GqZ4SsRaTZmKJMk/2U6gXbQDYUX/BJ4mNp2SiIyVFBV9BEnjC2HItbMPv+SwGDbBUux0PjTK0Uw==',key_name='tempest-keypair-118414557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-fj250k7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=c26d1d9c-4086-4d2a-9551-b1c4b388b0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_vif [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff93b3b2-8831-5399-a63a-e91818752fd5', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc546474a-e3, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc546474a-e3, col_values=(('qos', UUID('9f2a7c72-8446-43a9-986d-c6241883d1a0')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc546474a-e3, col_values=(('external_ids', {'iface-id': 'c546474a-e342-4eee-8398-789477c6a76d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:54:ac', 'vm-uuid': 'c26d1d9c-4086-4d2a-9551-b1c4b388b0ea'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 11 01:36:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:26 user nova-compute[75215]: INFO os_vif [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3')
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmYkatCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:36:26 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:36:26 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:36:26 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe1c56-0c7e-4582-a355-77aa48e6daf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:36:26 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No VIF found with MAC fa:16:3e:2a:54:ac, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a8d118-e723-4f52-8f14-099a80c7e076]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7] added
Nov 11 01:36:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5969775f-61e4-4e97-8925-15dbfe186f45]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae83842-a9ec-41ba-89b1-bd6971f5646b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmYkatCN {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmYkatCN" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf085711-7a91-4b30-a98c-25ae6cb83c52]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmYkatCN'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d6e76-c294-42eb-a276-1148c704136b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff41da98-d0c8-484c-8338-26486e9514e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b3d703-4489-4c65-8026-4802851340b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260]
Nov 11 01:36:26 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260] successful.
Nov 11 01:36:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-19c0cf20-476b-42ff-8fd7-969a359fdc61 req-048e9356-d30e-412e-86dc-133fa4aca17a service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updated VIF entry in instance network info cache for port c546474a-e342-4eee-8398-789477c6a76d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG nova.network.neutron [req-19c0cf20-476b-42ff-8fd7-969a359fdc61 req-048e9356-d30e-412e-86dc-133fa4aca17a service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe28639e-e49c-45ea-9553-72a0c1db357a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19c0cf20-476b-42ff-8fd7-969a359fdc61 req-048e9356-d30e-412e-86dc-133fa4aca17a service nova] Releasing lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c1600f-b1dd-4eee-8abc-d9a564438a2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:36:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1af21ab-3f89-4d8c-b6b1-d7937f1dbeac]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:36:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmYkatCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23237323466396633', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237323466396633', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1329016254',display_name='tempest-ServerActionsTestOtherA-server-1084493935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1329016254',id=14,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVPN5anh2XXeiivIGiHtn+WBt+rHOSMg3zh/uez0YkfrvS0adQ5fDROJuNHEVqbieRXHJf3+6tvz110BkRBpXfWJYP78Rb9BHIjC6wlzax3PwmZN+kJ+N61Edfk/zphA==',key_name='tempest-keypair-1076303283',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:33:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-fqo3dwe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=5c815cf9-c1d2-496c-b4f3-190dcd19ab98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:36:27 user nova-compute[75215]:   <uuid>5c815cf9-c1d2-496c-b4f3-190dcd19ab98</uuid>
Nov 11 01:36:27 user nova-compute[75215]:   <name>instance-0000000e</name>
Nov 11 01:36:27 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:36:27 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:36:27 user nova-compute[75215]:   <metadata>
Nov 11 01:36:27 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:36:27 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:36:27 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherA-server-1084493935</nova:name>
Nov 11 01:36:27 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:36:26</nova:creationTime>
Nov 11 01:36:27 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:36:27 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:36:27 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:36:27 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:36:27 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:36:27 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:36:27 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:36:27 user nova-compute[75215]:       <nova:owner>
Nov 11 01:36:27 user nova-compute[75215]:         <nova:user uuid="44e25bace5db43638b4eedfeb9215e24">tempest-ServerActionsTestOtherA-802983068-project-member</nova:user>
Nov 11 01:36:27 user nova-compute[75215]:         <nova:project uuid="c6fb80bd889f488bbfa25060dca25bb8">tempest-ServerActionsTestOtherA-802983068</nova:project>
Nov 11 01:36:27 user nova-compute[75215]:       </nova:owner>
Nov 11 01:36:27 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:36:27 user nova-compute[75215]:       <nova:ports>
Nov 11 01:36:27 user nova-compute[75215]:         <nova:port uuid="5e151329-5da5-4b43-a1d6-80c5fd4b9818">
Nov 11 01:36:27 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 01:36:27 user nova-compute[75215]:         </nova:port>
Nov 11 01:36:27 user nova-compute[75215]:       </nova:ports>
Nov 11 01:36:27 user nova-compute[75215]:     </nova:instance>
Nov 11 01:36:27 user nova-compute[75215]:   </metadata>
Nov 11 01:36:27 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:36:27 user nova-compute[75215]:     <system>
Nov 11 01:36:27 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:36:27 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:36:27 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:36:27 user nova-compute[75215]:       <entry name="serial">5c815cf9-c1d2-496c-b4f3-190dcd19ab98</entry>
Nov 11 01:36:27 user nova-compute[75215]:       <entry name="uuid">5c815cf9-c1d2-496c-b4f3-190dcd19ab98</entry>
Nov 11 01:36:27 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:36:27 user nova-compute[75215]:     </system>
Nov 11 01:36:27 user nova-compute[75215]:   </sysinfo>
Nov 11 01:36:27 user nova-compute[75215]:   <os>
Nov 11 01:36:27 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:36:27 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:36:27 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:36:27 user nova-compute[75215]:   </os>
Nov 11 01:36:27 user nova-compute[75215]:   <features>
Nov 11 01:36:27 user nova-compute[75215]:     <acpi/>
Nov 11 01:36:27 user nova-compute[75215]:     <apic/>
Nov 11 01:36:27 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:36:27 user nova-compute[75215]:   </features>
Nov 11 01:36:27 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:36:27 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:36:27 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:36:27 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:36:27 user nova-compute[75215]:   </clock>
Nov 11 01:36:27 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:36:27 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:36:27 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:36:27 user nova-compute[75215]:   </cpu>
Nov 11 01:36:27 user nova-compute[75215]:   <devices>
Nov 11 01:36:27 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:36:27 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:36:27 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk"/>
Nov 11 01:36:27 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:36:27 user nova-compute[75215]:     </disk>
Nov 11 01:36:27 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:36:27 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:36:27 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 11 01:36:27 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:36:27 user nova-compute[75215]:       <serial>7ab170cd-205e-489c-99c2-03f6a32873e7</serial>
Nov 11 01:36:27 user nova-compute[75215]:     </disk>
Nov 11 01:36:27 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:36:27 user nova-compute[75215]:       <mac address="fa:16:3e:57:cb:70"/>
Nov 11 01:36:27 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:36:27 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:36:27 user nova-compute[75215]:       <target dev="tap5e151329-5d"/>
Nov 11 01:36:27 user nova-compute[75215]:     </interface>
Nov 11 01:36:27 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:36:27 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/console.log" append="off"/>
Nov 11 01:36:27 user nova-compute[75215]:     </serial>
Nov 11 01:36:27 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:36:27 user nova-compute[75215]:     <video>
Nov 11 01:36:27 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:36:27 user nova-compute[75215]:     </video>
Nov 11 01:36:27 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:36:27 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:36:27 user nova-compute[75215]:     </rng>
Nov 11 01:36:27 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:36:27 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:36:27 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:36:27 user nova-compute[75215]:     </memballoon>
Nov 11 01:36:27 user nova-compute[75215]:   </devices>
Nov 11 01:36:27 user nova-compute[75215]: </domain>
Nov 11 01:36:27 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1329016254',display_name='tempest-ServerActionsTestOtherA-server-1084493935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1329016254',id=14,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVPN5anh2XXeiivIGiHtn+WBt+rHOSMg3zh/uez0YkfrvS0adQ5fDROJuNHEVqbieRXHJf3+6tvz110BkRBpXfWJYP78Rb9BHIjC6wlzax3PwmZN+kJ+N61Edfk/zphA==',key_name='tempest-keypair-1076303283',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:33:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-fqo3dwe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=5c815cf9-c1d2-496c-b4f3-190dcd19ab98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG os_vif [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2528dfe-da67-569e-9211-6866bb92c16c', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e151329-5d, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e151329-5d, col_values=(('qos', UUID('998c52b7-16c1-4997-b339-be648b73ce92')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e151329-5d, col_values=(('external_ids', {'iface-id': '5e151329-5da5-4b43-a1d6-80c5fd4b9818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:cb:70', 'vm-uuid': '5c815cf9-c1d2-496c-b4f3-190dcd19ab98'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:27 user nova-compute[75215]: INFO os_vif [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d')
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No VIF found with MAC fa:16:3e:57:cb:70, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:36:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-aba86fc3-373f-44bf-9959-cee977d13bef req-d00de91c-a656-4724-af3e-fbc50d63bd57 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aba86fc3-373f-44bf-9959-cee977d13bef req-d00de91c-a656-4724-af3e-fbc50d63bd57 service nova] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aba86fc3-373f-44bf-9959-cee977d13bef req-d00de91c-a656-4724-af3e-fbc50d63bd57 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aba86fc3-373f-44bf-9959-cee977d13bef req-d00de91c-a656-4724-af3e-fbc50d63bd57 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-aba86fc3-373f-44bf-9959-cee977d13bef req-d00de91c-a656-4724-af3e-fbc50d63bd57 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] No waiting events found dispatching network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:36:28 user nova-compute[75215]: WARNING nova.compute.manager [req-aba86fc3-373f-44bf-9959-cee977d13bef req-d00de91c-a656-4724-af3e-fbc50d63bd57 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received unexpected event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d for instance with vm_state building and task_state spawning.
Nov 11 01:36:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-05f8b09e-07f7-4601-a4fc-c105667cae26 req-6020c73a-31dc-4c54-82f2-33db183974c4 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05f8b09e-07f7-4601-a4fc-c105667cae26 req-6020c73a-31dc-4c54-82f2-33db183974c4 service nova] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05f8b09e-07f7-4601-a4fc-c105667cae26 req-6020c73a-31dc-4c54-82f2-33db183974c4 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05f8b09e-07f7-4601-a4fc-c105667cae26 req-6020c73a-31dc-4c54-82f2-33db183974c4 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-05f8b09e-07f7-4601-a4fc-c105667cae26 req-6020c73a-31dc-4c54-82f2-33db183974c4 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] No waiting events found dispatching network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:36:30 user nova-compute[75215]: WARNING nova.compute.manager [req-05f8b09e-07f7-4601-a4fc-c105667cae26 req-6020c73a-31dc-4c54-82f2-33db183974c4 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received unexpected event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 for instance with vm_state active and task_state rebuild_spawning.
Nov 11 01:36:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-6fe862d6-c564-43ab-ab95-55087dc971b4 req-6f1e92fa-0730-4b04-8a72-2098aea44be7 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6fe862d6-c564-43ab-ab95-55087dc971b4 req-6f1e92fa-0730-4b04-8a72-2098aea44be7 service nova] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6fe862d6-c564-43ab-ab95-55087dc971b4 req-6f1e92fa-0730-4b04-8a72-2098aea44be7 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6fe862d6-c564-43ab-ab95-55087dc971b4 req-6f1e92fa-0730-4b04-8a72-2098aea44be7 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-6fe862d6-c564-43ab-ab95-55087dc971b4 req-6f1e92fa-0730-4b04-8a72-2098aea44be7 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] No waiting events found dispatching network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:36:30 user nova-compute[75215]: WARNING nova.compute.manager [req-6fe862d6-c564-43ab-ab95-55087dc971b4 req-6f1e92fa-0730-4b04-8a72-2098aea44be7 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received unexpected event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d for instance with vm_state building and task_state spawning.
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:36:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance spawned successfully.
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:31 user nova-compute[75215]: INFO nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Took 7.54 seconds to spawn the instance on the hypervisor.
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:36:31 user nova-compute[75215]: INFO nova.compute.manager [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Took 8.45 seconds to build instance.
Nov 11 01:36:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5d8a4dd3-536b-466f-b03f-d75f0831e9df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.564s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:36:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance spawned successfully.
Nov 11 01:36:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-bd7a3c69-df99-4556-ac92-981aa5594ff0 req-90a4fd8a-35a4-4b5a-983c-e9e4bc56f95c service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd7a3c69-df99-4556-ac92-981aa5594ff0 req-90a4fd8a-35a4-4b5a-983c-e9e4bc56f95c service nova] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd7a3c69-df99-4556-ac92-981aa5594ff0 req-90a4fd8a-35a4-4b5a-983c-e9e4bc56f95c service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bd7a3c69-df99-4556-ac92-981aa5594ff0 req-90a4fd8a-35a4-4b5a-983c-e9e4bc56f95c service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-bd7a3c69-df99-4556-ac92-981aa5594ff0 req-90a4fd8a-35a4-4b5a-983c-e9e4bc56f95c service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] No waiting events found dispatching network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:36:32 user nova-compute[75215]: WARNING nova.compute.manager [req-bd7a3c69-df99-4556-ac92-981aa5594ff0 req-90a4fd8a-35a4-4b5a-983c-e9e4bc56f95c service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received unexpected event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 for instance with vm_state active and task_state rebuild_spawning.
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75215) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2871e0a4-6464-48b1-9c5e-bd30144cf278 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.111s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:47 user nova-compute[75215]: INFO nova.compute.manager [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Terminating instance
Nov 11 01:36:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ae323ef-e492-4fdc-a231-779053f4ddf0 req-dc4d4b4a-4496-4a38-bdaa-19ea47b80676 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received event network-vif-unplugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ae323ef-e492-4fdc-a231-779053f4ddf0 req-dc4d4b4a-4496-4a38-bdaa-19ea47b80676 service nova] Acquiring lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ae323ef-e492-4fdc-a231-779053f4ddf0 req-dc4d4b4a-4496-4a38-bdaa-19ea47b80676 service nova] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ae323ef-e492-4fdc-a231-779053f4ddf0 req-dc4d4b4a-4496-4a38-bdaa-19ea47b80676 service nova] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ae323ef-e492-4fdc-a231-779053f4ddf0 req-dc4d4b4a-4496-4a38-bdaa-19ea47b80676 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] No waiting events found dispatching network-vif-unplugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:36:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ae323ef-e492-4fdc-a231-779053f4ddf0 req-dc4d4b4a-4496-4a38-bdaa-19ea47b80676 service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received event network-vif-unplugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:36:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Instance destroyed successfully.
Nov 11 01:36:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lazy-loading 'resources' on Instance uuid 891f58ec-3924-4c75-b9cd-08d7f1f0f242 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2039148573',display_name='tempest-VolumesAdminNegativeTest-server-2039148573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2039148573',id=15,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9edee432deba4b9fa073619e1f9d99bb',ramdisk_id='',reservation_id='r-47dkj1lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1899827326',owner_user_name='tempest-VolumesAdminNegativeTest-1899827326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:34:43Z,user_data=None,user_id='80c298c7b4074bbcab91160215fb8537',uuid=891f58ec-3924-4c75-b9cd-08d7f1f0f242,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converting VIF {"id": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "address": "fa:16:3e:7e:1c:0e", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2946a312-cd", "ovs_interfaceid": "2946a312-cdf0-42fc-b6a5-1e9038a98f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=2946a312-cdf0-42fc-b6a5-1e9038a98f21,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2946a312-cd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG os_vif [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=2946a312-cdf0-42fc-b6a5-1e9038a98f21,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2946a312-cd') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2946a312-cd, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dea3d2b-e2da-4099-8540-933865e20439) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:48 user nova-compute[75215]: INFO os_vif [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=2946a312-cdf0-42fc-b6a5-1e9038a98f21,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2946a312-cd')
Nov 11 01:36:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Deleting instance files /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242_del
Nov 11 01:36:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Deletion of /opt/stack/data/nova/instances/891f58ec-3924-4c75-b9cd-08d7f1f0f242_del complete
Nov 11 01:36:48 user nova-compute[75215]: INFO nova.compute.manager [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 11 01:36:48 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:36:48 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Took 0.69 seconds to deallocate network for instance.
Nov 11 01:36:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-d818befa-f8ed-46df-b46c-18848d98be52 req-f101af37-a7f3-42b8-8e88-1496f2bf683d service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received event network-vif-deleted-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:49 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:36:49 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:36:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:49 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Deleted allocations for instance 891f58ec-3924-4c75-b9cd-08d7f1f0f242
Nov 11 01:36:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8543a084-99ba-4081-bbe3-a7b27e6ff7d2 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-7557138e-bb10-436d-b7ae-94251a435cb9 req-e5928fb0-561b-44ac-b522-23ce55d3eb6f service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received event network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7557138e-bb10-436d-b7ae-94251a435cb9 req-e5928fb0-561b-44ac-b522-23ce55d3eb6f service nova] Acquiring lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7557138e-bb10-436d-b7ae-94251a435cb9 req-e5928fb0-561b-44ac-b522-23ce55d3eb6f service nova] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7557138e-bb10-436d-b7ae-94251a435cb9 req-e5928fb0-561b-44ac-b522-23ce55d3eb6f service nova] Lock "891f58ec-3924-4c75-b9cd-08d7f1f0f242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-7557138e-bb10-436d-b7ae-94251a435cb9 req-e5928fb0-561b-44ac-b522-23ce55d3eb6f service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] No waiting events found dispatching network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:36:50 user nova-compute[75215]: WARNING nova.compute.manager [req-7557138e-bb10-436d-b7ae-94251a435cb9 req-e5928fb0-561b-44ac-b522-23ce55d3eb6f service nova] [instance: 891f58ec-3924-4c75-b9cd-08d7f1f0f242] Received unexpected event network-vif-plugged-2946a312-cdf0-42fc-b6a5-1e9038a98f21 for instance with vm_state deleted and task_state None.
Nov 11 01:36:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "7c0050d8-917e-4c39-848d-4f1370956954" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "7c0050d8-917e-4c39-848d-4f1370956954" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:36:51 user nova-compute[75215]: INFO nova.compute.claims [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Claim successful on node user
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:36:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.policy [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1364d089216946da82c04a6751554063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36246bf14ac41709b672152797892ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:36:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Creating image(s)
Nov 11 01:36:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "/opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "/opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk 1073741824" returned: 0 in 0.058s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Successfully created port: 9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Cannot resize image /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Ensure instance console log exists: /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:52 user nova-compute[75215]: INFO nova.compute.manager [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Detaching volume 36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:36:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:53 user nova-compute[75215]: INFO nova.virt.block_device [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Attempting to driver detach volume 36d2eade-7266-431a-841c-7bd5c33569e5 from mountpoint /dev/vdb
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Attempting to detach device vdb from instance 29f5d275-78e7-4292-98c8-d12f47f28fbf from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:36:53 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:36:53 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:36:53 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:36:53 user nova-compute[75215]:   <serial>36d2eade-7266-431a-841c-7bd5c33569e5</serial>
Nov 11 01:36:53 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 01:36:53 user nova-compute[75215]: </disk>
Nov 11 01:36:53 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:36:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully detached device vdb from instance 29f5d275-78e7-4292-98c8-d12f47f28fbf from the persistent domain config.
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29f5d275-78e7-4292-98c8-d12f47f28fbf from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:36:53 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:36:53 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:36:53 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:36:53 user nova-compute[75215]:   <serial>36d2eade-7266-431a-841c-7bd5c33569e5</serial>
Nov 11 01:36:53 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 01:36:53 user nova-compute[75215]: </disk>
Nov 11 01:36:53 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Successfully updated port: 9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "refresh_cache-7c0050d8-917e-4c39-848d-4f1370956954" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquired lock "refresh_cache-7c0050d8-917e-4c39-848d-4f1370956954" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-e8f75657-c464-4b06-b2f4-0028998c0917 req-e583c1ca-9265-420b-b35d-4c87e03a8e13 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received event network-changed-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-e8f75657-c464-4b06-b2f4-0028998c0917 req-e583c1ca-9265-420b-b35d-4c87e03a8e13 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Refreshing instance network info cache due to event network-changed-9c301726-ca45-44b5-a9e9-ba59d72de74c. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8f75657-c464-4b06-b2f4-0028998c0917 req-e583c1ca-9265-420b-b35d-4c87e03a8e13 service nova] Acquiring lock "refresh_cache-7c0050d8-917e-4c39-848d-4f1370956954" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Updating instance_info_cache with network_info: [{"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Releasing lock "refresh_cache-7c0050d8-917e-4c39-848d-4f1370956954" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Instance network_info: |[{"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8f75657-c464-4b06-b2f4-0028998c0917 req-e583c1ca-9265-420b-b35d-4c87e03a8e13 service nova] Acquired lock "refresh_cache-7c0050d8-917e-4c39-848d-4f1370956954" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-e8f75657-c464-4b06-b2f4-0028998c0917 req-e583c1ca-9265-420b-b35d-4c87e03a8e13 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Refreshing network info cache for port 9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Start _get_guest_xml network_info=[{"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:36:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:36:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:36:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-695666396',display_name='tempest-VolumesActionsTest-instance-695666396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-695666396',id=17,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a36246bf14ac41709b672152797892ec',ramdisk_id='',reservation_id='r-n66y6ndg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-602409437',owner_user_name='tempest-VolumesActionsTest-602409437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:36:52Z,user_data=None,user_id='1364d089216946da82c04a6751554063',uuid=7c0050d8-917e-4c39-848d-4f1370956954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Converting VIF {"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=9c301726-ca45-44b5-a9e9-ba59d72de74c,network=Network(1dc6459e-8032-440a-998b-b8f2ad657a2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c301726-ca') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c0050d8-917e-4c39-848d-4f1370956954 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:36:54 user nova-compute[75215]:   <uuid>7c0050d8-917e-4c39-848d-4f1370956954</uuid>
Nov 11 01:36:54 user nova-compute[75215]:   <name>instance-00000011</name>
Nov 11 01:36:54 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:36:54 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:36:54 user nova-compute[75215]:   <metadata>
Nov 11 01:36:54 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:36:54 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:36:54 user nova-compute[75215]:       <nova:name>tempest-VolumesActionsTest-instance-695666396</nova:name>
Nov 11 01:36:54 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:36:53</nova:creationTime>
Nov 11 01:36:54 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:36:54 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:36:54 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:36:54 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:36:54 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:36:54 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:36:54 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:36:54 user nova-compute[75215]:       <nova:owner>
Nov 11 01:36:54 user nova-compute[75215]:         <nova:user uuid="1364d089216946da82c04a6751554063">tempest-VolumesActionsTest-602409437-project-member</nova:user>
Nov 11 01:36:54 user nova-compute[75215]:         <nova:project uuid="a36246bf14ac41709b672152797892ec">tempest-VolumesActionsTest-602409437</nova:project>
Nov 11 01:36:54 user nova-compute[75215]:       </nova:owner>
Nov 11 01:36:54 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:36:54 user nova-compute[75215]:       <nova:ports>
Nov 11 01:36:54 user nova-compute[75215]:         <nova:port uuid="9c301726-ca45-44b5-a9e9-ba59d72de74c">
Nov 11 01:36:54 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:36:54 user nova-compute[75215]:         </nova:port>
Nov 11 01:36:54 user nova-compute[75215]:       </nova:ports>
Nov 11 01:36:54 user nova-compute[75215]:     </nova:instance>
Nov 11 01:36:54 user nova-compute[75215]:   </metadata>
Nov 11 01:36:54 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:36:54 user nova-compute[75215]:     <system>
Nov 11 01:36:54 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:36:54 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:36:54 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:36:54 user nova-compute[75215]:       <entry name="serial">7c0050d8-917e-4c39-848d-4f1370956954</entry>
Nov 11 01:36:54 user nova-compute[75215]:       <entry name="uuid">7c0050d8-917e-4c39-848d-4f1370956954</entry>
Nov 11 01:36:54 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:36:54 user nova-compute[75215]:     </system>
Nov 11 01:36:54 user nova-compute[75215]:   </sysinfo>
Nov 11 01:36:54 user nova-compute[75215]:   <os>
Nov 11 01:36:54 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:36:54 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:36:54 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:36:54 user nova-compute[75215]:   </os>
Nov 11 01:36:54 user nova-compute[75215]:   <features>
Nov 11 01:36:54 user nova-compute[75215]:     <acpi/>
Nov 11 01:36:54 user nova-compute[75215]:     <apic/>
Nov 11 01:36:54 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:36:54 user nova-compute[75215]:   </features>
Nov 11 01:36:54 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:36:54 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:36:54 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:36:54 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:36:54 user nova-compute[75215]:   </clock>
Nov 11 01:36:54 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:36:54 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:36:54 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:36:54 user nova-compute[75215]:   </cpu>
Nov 11 01:36:54 user nova-compute[75215]:   <devices>
Nov 11 01:36:54 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:36:54 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:36:54 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk"/>
Nov 11 01:36:54 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:36:54 user nova-compute[75215]:     </disk>
Nov 11 01:36:54 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:36:54 user nova-compute[75215]:       <mac address="fa:16:3e:2d:bb:b9"/>
Nov 11 01:36:54 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:36:54 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:36:54 user nova-compute[75215]:       <target dev="tap9c301726-ca"/>
Nov 11 01:36:54 user nova-compute[75215]:     </interface>
Nov 11 01:36:54 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:36:54 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/console.log" append="off"/>
Nov 11 01:36:54 user nova-compute[75215]:     </serial>
Nov 11 01:36:54 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:36:54 user nova-compute[75215]:     <video>
Nov 11 01:36:54 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:36:54 user nova-compute[75215]:     </video>
Nov 11 01:36:54 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:36:54 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:36:54 user nova-compute[75215]:     </rng>
Nov 11 01:36:54 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:36:54 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:36:54 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:36:54 user nova-compute[75215]:     </memballoon>
Nov 11 01:36:54 user nova-compute[75215]:   </devices>
Nov 11 01:36:54 user nova-compute[75215]: </domain>
Nov 11 01:36:54 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-695666396',display_name='tempest-VolumesActionsTest-instance-695666396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-695666396',id=17,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a36246bf14ac41709b672152797892ec',ramdisk_id='',reservation_id='r-n66y6ndg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-602409437',owner_user_name='tempest-VolumesActionsTest-602409437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:36:52Z,user_data=None,user_id='1364d089216946da82c04a6751554063',uuid=7c0050d8-917e-4c39-848d-4f1370956954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Converting VIF {"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=9c301726-ca45-44b5-a9e9-ba59d72de74c,network=Network(1dc6459e-8032-440a-998b-b8f2ad657a2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c301726-ca') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG os_vif [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=9c301726-ca45-44b5-a9e9-ba59d72de74c,network=Network(1dc6459e-8032-440a-998b-b8f2ad657a2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c301726-ca') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '211f9c54-43ab-5fc9-81be-bab1e328c55f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c301726-ca, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c301726-ca, col_values=(('qos', UUID('979d3d7c-c52c-497f-976c-051f94e98019')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c301726-ca, col_values=(('external_ids', {'iface-id': '9c301726-ca45-44b5-a9e9-ba59d72de74c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:bb:b9', 'vm-uuid': '7c0050d8-917e-4c39-848d-4f1370956954'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:54 user nova-compute[75215]: INFO os_vif [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=9c301726-ca45-44b5-a9e9-ba59d72de74c,network=Network(1dc6459e-8032-440a-998b-b8f2ad657a2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c301726-ca')
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] No VIF found with MAC fa:16:3e:2d:bb:b9, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.network.neutron [req-e8f75657-c464-4b06-b2f4-0028998c0917 req-e583c1ca-9265-420b-b35d-4c87e03a8e13 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Updated VIF entry in instance network info cache for port 9c301726-ca45-44b5-a9e9-ba59d72de74c. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG nova.network.neutron [req-e8f75657-c464-4b06-b2f4-0028998c0917 req-e583c1ca-9265-420b-b35d-4c87e03a8e13 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Updating instance_info_cache with network_info: [{"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:36:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8f75657-c464-4b06-b2f4-0028998c0917 req-e583c1ca-9265-420b-b35d-4c87e03a8e13 service nova] Releasing lock "refresh_cache-7c0050d8-917e-4c39-848d-4f1370956954" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-5c9cab99-8a4d-47fa-9710-6da97634aa84 req-663fb94e-34c0-4587-89c8-8edc39a24cc2 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received event network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c9cab99-8a4d-47fa-9710-6da97634aa84 req-663fb94e-34c0-4587-89c8-8edc39a24cc2 service nova] Acquiring lock "7c0050d8-917e-4c39-848d-4f1370956954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c9cab99-8a4d-47fa-9710-6da97634aa84 req-663fb94e-34c0-4587-89c8-8edc39a24cc2 service nova] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c9cab99-8a4d-47fa-9710-6da97634aa84 req-663fb94e-34c0-4587-89c8-8edc39a24cc2 service nova] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-5c9cab99-8a4d-47fa-9710-6da97634aa84 req-663fb94e-34c0-4587-89c8-8edc39a24cc2 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] No waiting events found dispatching network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:36:55 user nova-compute[75215]: WARNING nova.compute.manager [req-5c9cab99-8a4d-47fa-9710-6da97634aa84 req-663fb94e-34c0-4587-89c8-8edc39a24cc2 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received unexpected event network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c for instance with vm_state building and task_state spawning.
Nov 11 01:36:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:57 user nova-compute[75215]: INFO nova.compute.manager [None req-11a53434-9753-4827-ab60-21f02301c958 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Unrescuing
Nov 11 01:36:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-11a53434-9753-4827-ab60-21f02301c958 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:36:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-11a53434-9753-4827-ab60-21f02301c958 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquired lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:36:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-11a53434-9753-4827-ab60-21f02301c958 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:36:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-11a53434-9753-4827-ab60-21f02301c958 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updating instance_info_cache with network_info: [{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:36:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-11a53434-9753-4827-ab60-21f02301c958 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Releasing lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:36:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-11a53434-9753-4827-ab60-21f02301c958 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'flavor' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:36:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-026fadf2-c7f8-491b-8a13-9eee67c3c48e req-ad81147f-1dc4-420c-b9b1-eb90bdcbe7a8 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received event network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-026fadf2-c7f8-491b-8a13-9eee67c3c48e req-ad81147f-1dc4-420c-b9b1-eb90bdcbe7a8 service nova] Acquiring lock "7c0050d8-917e-4c39-848d-4f1370956954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-026fadf2-c7f8-491b-8a13-9eee67c3c48e req-ad81147f-1dc4-420c-b9b1-eb90bdcbe7a8 service nova] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-026fadf2-c7f8-491b-8a13-9eee67c3c48e req-ad81147f-1dc4-420c-b9b1-eb90bdcbe7a8 service nova] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-026fadf2-c7f8-491b-8a13-9eee67c3c48e req-ad81147f-1dc4-420c-b9b1-eb90bdcbe7a8 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] No waiting events found dispatching network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:36:58 user nova-compute[75215]: WARNING nova.compute.manager [req-026fadf2-c7f8-491b-8a13-9eee67c3c48e req-ad81147f-1dc4-420c-b9b1-eb90bdcbe7a8 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received unexpected event network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c for instance with vm_state building and task_state spawning.
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:36:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Instance spawned successfully.
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:58 user nova-compute[75215]: INFO nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 11 01:36:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance destroyed successfully.
Nov 11 01:36:58 user nova-compute[75215]: INFO nova.compute.manager [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Took 7.55 seconds to build instance.
Nov 11 01:36:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9777efb9-a4ab-413c-be86-3d381944fb51 tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "7c0050d8-917e-4c39-848d-4f1370956954" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.672s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:36:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:00 user nova-compute[75215]: WARNING nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:00 user nova-compute[75215]: WARNING nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:00 user nova-compute[75215]: WARNING nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:00 user nova-compute[75215]: WARNING nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:00 user nova-compute[75215]: WARNING nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:00 user nova-compute[75215]: WARNING nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:00 user nova-compute[75215]: WARNING nova.compute.manager [req-b340843c-d06f-46a0-a23c-ffb021db4413 req-d6963a8a-c521-4af9-a57b-aacb4d4fb09b service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:37:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-11a53434-9753-4827-ab60-21f02301c958 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:37:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a13cece-57c9-4ca3-8ded-17c5c9d10118 req-c4e96c0e-2d8f-4e7f-b206-50fce6190f64 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a13cece-57c9-4ca3-8ded-17c5c9d10118 req-c4e96c0e-2d8f-4e7f-b206-50fce6190f64 service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a13cece-57c9-4ca3-8ded-17c5c9d10118 req-c4e96c0e-2d8f-4e7f-b206-50fce6190f64 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a13cece-57c9-4ca3-8ded-17c5c9d10118 req-c4e96c0e-2d8f-4e7f-b206-50fce6190f64 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a13cece-57c9-4ca3-8ded-17c5c9d10118 req-c4e96c0e-2d8f-4e7f-b206-50fce6190f64 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:02 user nova-compute[75215]: WARNING nova.compute.manager [req-7a13cece-57c9-4ca3-8ded-17c5c9d10118 req-c4e96c0e-2d8f-4e7f-b206-50fce6190f64 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state active and task_state None.
Nov 11 01:37:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:03 user nova-compute[75215]: INFO nova.compute.manager [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Detaching volume b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:37:03 user nova-compute[75215]: INFO nova.virt.block_device [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Attempting to driver detach volume b101360e-a77f-4282-9c80-250fadec0c83 from mountpoint /dev/vdb
Nov 11 01:37:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Attempting to detach device vdb from instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:37:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:37:03 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:37:03 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 11 01:37:03 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:37:03 user nova-compute[75215]:   <serial>b101360e-a77f-4282-9c80-250fadec0c83</serial>
Nov 11 01:37:03 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:37:03 user nova-compute[75215]: </disk>
Nov 11 01:37:03 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:37:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Successfully detached device vdb from instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 from the persistent domain config.
Nov 11 01:37:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:37:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:37:03 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:37:03 user nova-compute[75215]:   <source dev="/dev/sdg"/>
Nov 11 01:37:03 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:37:03 user nova-compute[75215]:   <serial>b101360e-a77f-4282-9c80-250fadec0c83</serial>
Nov 11 01:37:03 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:37:03 user nova-compute[75215]: </disk>
Nov 11 01:37:03 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:37:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:37:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:12 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:37:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 29f5d275-78e7-4292-98c8-d12f47f28fbf is timed out.
Nov 11 01:37:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully detached device vdb from instance 29f5d275-78e7-4292-98c8-d12f47f28fbf from the live domain config.
Nov 11 01:37:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veykfYdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:37:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a03d0f-7b84-413f-bf02-6e1cc30e6ef4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:37:13 user nova-compute[75215]: No targets found.
Nov 11 01:37:13 user nova-compute[75215]: iSNS:
Nov 11 01:37:13 user nova-compute[75215]: No targets found.
Nov 11 01:37:13 user nova-compute[75215]: STATIC:
Nov 11 01:37:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5
Nov 11 01:37:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:37:13 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:37:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:37:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:37:13 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:37:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:37:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:37:13 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:37:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7
Nov 11 01:37:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:37:13 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:37:13 user nova-compute[75215]: FIRMWARE:
Nov 11 01:37:13 user nova-compute[75215]: No targets found.
Nov 11 01:37:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:37:13 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:37:13 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da731e4-ed73-4055-9314-b47e9000c608]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca95d1-dd38-495e-804d-806470854173]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:37:13 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:37:13 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:37:13 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:37:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:37:13 user nova-compute[75215]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 (non-flash)
Nov 11 01:37:13 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:37:13 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:37:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40442a7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cbdc65-cc06-45e4-9cb7-40dc0e6d25ef]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe10203e-bc48-45b1-ae4b-114948c4d633]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d92553-0c60-4fc9-ab62-66046e9bebc6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c9876f-a880-4da7-b8a2-8150db4a43bd]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09cb670-5a09-43dc-807b-a6ab2a36f8f4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[46969d1d-63ce-4e48-aa92-e7f41f137985]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260]
Nov 11 01:37:13 user nova-compute[75215]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5, portal: 172.16.0.220,3260] successful.
Nov 11 01:37:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2eade-7266-431a-841c-7bd5c33569e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7ae711-2e6a-4b97-aa09-de935f54d575]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== disconnect_volume: return (354ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:37:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG nova.objects.instance [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-937f3fc7-d7b0-4f68-9a07-c70a27da4f3b tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.013s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c5cd00a-9e8e-4d76-982d-bdb5f63ea25e tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c5cd00a-9e8e-4d76-982d-bdb5f63ea25e tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3c5cd00a-9e8e-4d76-982d-bdb5f63ea25e tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3c5cd00a-9e8e-4d76-982d-bdb5f63ea25e tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75215) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 11 01:37:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3c5cd00a-9e8e-4d76-982d-bdb5f63ea25e tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:37:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-3729510d-76a9-4a73-80ec-0cf4f2e09992 req-9b38036e-abda-463b-b144-5ae6117333d7 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3729510d-76a9-4a73-80ec-0cf4f2e09992 req-9b38036e-abda-463b-b144-5ae6117333d7 service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3729510d-76a9-4a73-80ec-0cf4f2e09992 req-9b38036e-abda-463b-b144-5ae6117333d7 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3729510d-76a9-4a73-80ec-0cf4f2e09992 req-9b38036e-abda-463b-b144-5ae6117333d7 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-3729510d-76a9-4a73-80ec-0cf4f2e09992 req-9b38036e-abda-463b-b144-5ae6117333d7 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:17 user nova-compute[75215]: WARNING nova.compute.manager [req-3729510d-76a9-4a73-80ec-0cf4f2e09992 req-9b38036e-abda-463b-b144-5ae6117333d7 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state active and task_state powering-off.
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:37:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.417922973632812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance destroyed successfully.
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3c5cd00a-9e8e-4d76-982d-bdb5f63ea25e tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c5cd00a-9e8e-4d76-982d-bdb5f63ea25e tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.519s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7c0050d8-917e-4c39-848d-4f1370956954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:37:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.780s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.660s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:37:18 user nova-compute[75215]: INFO nova.compute.claims [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Claim successful on node user
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-1b9a88dc-b963-4909-a172-a7268246102c req-56ef097c-9aa4-42d0-90a1-6fe7d4db92e4 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b9a88dc-b963-4909-a172-a7268246102c req-56ef097c-9aa4-42d0-90a1-6fe7d4db92e4 service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b9a88dc-b963-4909-a172-a7268246102c req-56ef097c-9aa4-42d0-90a1-6fe7d4db92e4 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b9a88dc-b963-4909-a172-a7268246102c req-56ef097c-9aa4-42d0-90a1-6fe7d4db92e4 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-1b9a88dc-b963-4909-a172-a7268246102c req-56ef097c-9aa4-42d0-90a1-6fe7d4db92e4 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:18 user nova-compute[75215]: WARNING nova.compute.manager [req-1b9a88dc-b963-4909-a172-a7268246102c req-56ef097c-9aa4-42d0-90a1-6fe7d4db92e4 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state stopped and task_state None.
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:37:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.policy [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec2a1a4aed354d499952775c177f376f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351ac5c20f4fa0be12a86bd5cd5ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:37:18 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Creating image(s)
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "/opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "/opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk 1073741824" returned: 0 in 0.058s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Successfully created port: 524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Cannot resize image /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Ensure instance console log exists: /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Successfully updated port: 524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "refresh_cache-e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquired lock "refresh_cache-e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-11ca3c15-e6ff-4653-a563-aa0acd9047e2 req-f040e129-b704-4817-b89f-1897edaa85b8 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received event network-changed-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-11ca3c15-e6ff-4653-a563-aa0acd9047e2 req-f040e129-b704-4817-b89f-1897edaa85b8 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Refreshing instance network info cache due to event network-changed-524d7d2f-fe62-4f74-bb17-4d1df8708009. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11ca3c15-e6ff-4653-a563-aa0acd9047e2 req-f040e129-b704-4817-b89f-1897edaa85b8 service nova] Acquiring lock "refresh_cache-e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Updating instance_info_cache with network_info: [{"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Releasing lock "refresh_cache-e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Instance network_info: |[{"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11ca3c15-e6ff-4653-a563-aa0acd9047e2 req-f040e129-b704-4817-b89f-1897edaa85b8 service nova] Acquired lock "refresh_cache-e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-11ca3c15-e6ff-4653-a563-aa0acd9047e2 req-f040e129-b704-4817-b89f-1897edaa85b8 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Refreshing network info cache for port 524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Start _get_guest_xml network_info=[{"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:37:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:37:20 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-393253023',display_name='tempest-VolumesActionsTest-instance-393253023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-393253023',id=18,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28351ac5c20f4fa0be12a86bd5cd5ce9',ramdisk_id='',reservation_id='r-0vu0v8re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-979308973',owner_user_name='tempest-VolumesActionsTest-979308973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:37:19Z,user_data=None,user_id='ec2a1a4aed354d499952775c177f376f',uuid=e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converting VIF {"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c6:4b,bridge_name='br-int',has_traffic_filtering=True,id=524d7d2f-fe62-4f74-bb17-4d1df8708009,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524d7d2f-fe') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.objects.instance [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lazy-loading 'pci_devices' on Instance uuid e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:37:20 user nova-compute[75215]:   <uuid>e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5</uuid>
Nov 11 01:37:20 user nova-compute[75215]:   <name>instance-00000012</name>
Nov 11 01:37:20 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:37:20 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:37:20 user nova-compute[75215]:   <metadata>
Nov 11 01:37:20 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:37:20 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:37:20 user nova-compute[75215]:       <nova:name>tempest-VolumesActionsTest-instance-393253023</nova:name>
Nov 11 01:37:20 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:37:20</nova:creationTime>
Nov 11 01:37:20 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:37:20 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:37:20 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:37:20 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:37:20 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:37:20 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:37:20 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:37:20 user nova-compute[75215]:       <nova:owner>
Nov 11 01:37:20 user nova-compute[75215]:         <nova:user uuid="ec2a1a4aed354d499952775c177f376f">tempest-VolumesActionsTest-979308973-project-member</nova:user>
Nov 11 01:37:20 user nova-compute[75215]:         <nova:project uuid="28351ac5c20f4fa0be12a86bd5cd5ce9">tempest-VolumesActionsTest-979308973</nova:project>
Nov 11 01:37:20 user nova-compute[75215]:       </nova:owner>
Nov 11 01:37:20 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:37:20 user nova-compute[75215]:       <nova:ports>
Nov 11 01:37:20 user nova-compute[75215]:         <nova:port uuid="524d7d2f-fe62-4f74-bb17-4d1df8708009">
Nov 11 01:37:20 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:37:20 user nova-compute[75215]:         </nova:port>
Nov 11 01:37:20 user nova-compute[75215]:       </nova:ports>
Nov 11 01:37:20 user nova-compute[75215]:     </nova:instance>
Nov 11 01:37:20 user nova-compute[75215]:   </metadata>
Nov 11 01:37:20 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:37:20 user nova-compute[75215]:     <system>
Nov 11 01:37:20 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:37:20 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:37:20 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:37:20 user nova-compute[75215]:       <entry name="serial">e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5</entry>
Nov 11 01:37:20 user nova-compute[75215]:       <entry name="uuid">e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5</entry>
Nov 11 01:37:20 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:37:20 user nova-compute[75215]:     </system>
Nov 11 01:37:20 user nova-compute[75215]:   </sysinfo>
Nov 11 01:37:20 user nova-compute[75215]:   <os>
Nov 11 01:37:20 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:37:20 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:37:20 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:37:20 user nova-compute[75215]:   </os>
Nov 11 01:37:20 user nova-compute[75215]:   <features>
Nov 11 01:37:20 user nova-compute[75215]:     <acpi/>
Nov 11 01:37:20 user nova-compute[75215]:     <apic/>
Nov 11 01:37:20 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:37:20 user nova-compute[75215]:   </features>
Nov 11 01:37:20 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:37:20 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:37:20 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:37:20 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:37:20 user nova-compute[75215]:   </clock>
Nov 11 01:37:20 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:37:20 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:37:20 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:37:20 user nova-compute[75215]:   </cpu>
Nov 11 01:37:20 user nova-compute[75215]:   <devices>
Nov 11 01:37:20 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:37:20 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:37:20 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk"/>
Nov 11 01:37:20 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:37:20 user nova-compute[75215]:     </disk>
Nov 11 01:37:20 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:37:20 user nova-compute[75215]:       <mac address="fa:16:3e:8d:c6:4b"/>
Nov 11 01:37:20 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:37:20 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:37:20 user nova-compute[75215]:       <target dev="tap524d7d2f-fe"/>
Nov 11 01:37:20 user nova-compute[75215]:     </interface>
Nov 11 01:37:20 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:37:20 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/console.log" append="off"/>
Nov 11 01:37:20 user nova-compute[75215]:     </serial>
Nov 11 01:37:20 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:37:20 user nova-compute[75215]:     <video>
Nov 11 01:37:20 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:37:20 user nova-compute[75215]:     </video>
Nov 11 01:37:20 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:37:20 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:37:20 user nova-compute[75215]:     </rng>
Nov 11 01:37:20 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:37:20 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:37:20 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:37:20 user nova-compute[75215]:     </memballoon>
Nov 11 01:37:20 user nova-compute[75215]:   </devices>
Nov 11 01:37:20 user nova-compute[75215]: </domain>
Nov 11 01:37:20 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-393253023',display_name='tempest-VolumesActionsTest-instance-393253023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-393253023',id=18,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28351ac5c20f4fa0be12a86bd5cd5ce9',ramdisk_id='',reservation_id='r-0vu0v8re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-979308973',owner_user_name='tempest-VolumesActionsTest-979308973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:37:19Z,user_data=None,user_id='ec2a1a4aed354d499952775c177f376f',uuid=e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converting VIF {"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c6:4b,bridge_name='br-int',has_traffic_filtering=True,id=524d7d2f-fe62-4f74-bb17-4d1df8708009,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524d7d2f-fe') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG os_vif [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c6:4b,bridge_name='br-int',has_traffic_filtering=True,id=524d7d2f-fe62-4f74-bb17-4d1df8708009,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524d7d2f-fe') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0f9ded6-822a-5961-b9af-cd21587c68e0', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap524d7d2f-fe, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap524d7d2f-fe, col_values=(('qos', UUID('29844d1c-e98d-43a0-99a6-45425e659db7')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap524d7d2f-fe, col_values=(('external_ids', {'iface-id': '524d7d2f-fe62-4f74-bb17-4d1df8708009', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:c6:4b', 'vm-uuid': 'e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:20 user nova-compute[75215]: INFO os_vif [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c6:4b,bridge_name='br-int',has_traffic_filtering=True,id=524d7d2f-fe62-4f74-bb17-4d1df8708009,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524d7d2f-fe')
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:37:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] No VIF found with MAC fa:16:3e:8d:c6:4b, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-11ca3c15-e6ff-4653-a563-aa0acd9047e2 req-f040e129-b704-4817-b89f-1897edaa85b8 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Updated VIF entry in instance network info cache for port 524d7d2f-fe62-4f74-bb17-4d1df8708009. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-11ca3c15-e6ff-4653-a563-aa0acd9047e2 req-f040e129-b704-4817-b89f-1897edaa85b8 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Updating instance_info_cache with network_info: [{"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-11ca3c15-e6ff-4653-a563-aa0acd9047e2 req-f040e129-b704-4817-b89f-1897edaa85b8 service nova] Releasing lock "refresh_cache-e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updating instance_info_cache with network_info: [{"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-29f1747f-8209-4d8f-9929-d6227763b5c5" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:37:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-5ebb093c-698a-40c9-b820-f8fbfbcc6fbc req-d8589f03-cc95-49b5-95f9-2dcae5335f76 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received event network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ebb093c-698a-40c9-b820-f8fbfbcc6fbc req-d8589f03-cc95-49b5-95f9-2dcae5335f76 service nova] Acquiring lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ebb093c-698a-40c9-b820-f8fbfbcc6fbc req-d8589f03-cc95-49b5-95f9-2dcae5335f76 service nova] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5ebb093c-698a-40c9-b820-f8fbfbcc6fbc req-d8589f03-cc95-49b5-95f9-2dcae5335f76 service nova] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-5ebb093c-698a-40c9-b820-f8fbfbcc6fbc req-d8589f03-cc95-49b5-95f9-2dcae5335f76 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] No waiting events found dispatching network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:22 user nova-compute[75215]: WARNING nova.compute.manager [req-5ebb093c-698a-40c9-b820-f8fbfbcc6fbc req-d8589f03-cc95-49b5-95f9-2dcae5335f76 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received unexpected event network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 for instance with vm_state building and task_state spawning.
Nov 11 01:37:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:23 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 is timed out.
Nov 11 01:37:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Successfully detached device vdb from instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 from the live domain config.
Nov 11 01:37:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqynFHUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:37:23 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47249557-062c-40b7-80fb-d2754a5cf02b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:37:23 user nova-compute[75215]: No targets found.
Nov 11 01:37:23 user nova-compute[75215]: iSNS:
Nov 11 01:37:23 user nova-compute[75215]: No targets found.
Nov 11 01:37:23 user nova-compute[75215]: STATIC:
Nov 11 01:37:23 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:37:23 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:37:23 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:37:23 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83
Nov 11 01:37:23 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:37:23 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:37:23 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7
Nov 11 01:37:23 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:37:23 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:37:23 user nova-compute[75215]: FIRMWARE:
Nov 11 01:37:23 user nova-compute[75215]: No targets found.
Nov 11 01:37:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:37:23 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:37:23 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1875204b-56cc-415f-8152-5b7a0eae9913]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bb7f0a-c5af-4b55-9910-2757a01b0714]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:37:23 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:37:23 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:37:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:37:23 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:37:23 user nova-compute[75215]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 (non-flash)
Nov 11 01:37:23 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40442a5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83'): ({'sdg'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Removing single pathed devices sdg {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:37:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1319ca3b-62bf-43d5-aeb3-608baa0df676]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39e1b63-814a-4914-a4ac-ba42f162509d]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Flushing IO for device /dev/sdg {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7be9d-2c67-4f1a-9c58-d52b81f6993e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d229083-4811-4003-8869-0e8570ded62d]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] SCSI volumes sdg have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b085ba-fd35-4505-ad81-e087c2eecbc6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7012ee-356d-49d5-983f-5f5f77267305]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83, portal: 172.16.0.220,3260]
Nov 11 01:37:24 user nova-compute[75215]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83, portal: 172.16.0.220,3260] successful.
Nov 11 01:37:24 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b101360e-a77f-4282-9c80-250fadec0c83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[070de7d7-82f6-496a-b72b-050d709aaf97]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] <== disconnect_volume: return (323ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:37:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Instance spawned successfully.
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-214fd8d7-9fd4-4e68-8721-c78baf029903 req-fd8bbf36-aaba-42a7-9eaf-ffda2eaba9d5 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received event network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-214fd8d7-9fd4-4e68-8721-c78baf029903 req-fd8bbf36-aaba-42a7-9eaf-ffda2eaba9d5 service nova] Acquiring lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-214fd8d7-9fd4-4e68-8721-c78baf029903 req-fd8bbf36-aaba-42a7-9eaf-ffda2eaba9d5 service nova] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-214fd8d7-9fd4-4e68-8721-c78baf029903 req-fd8bbf36-aaba-42a7-9eaf-ffda2eaba9d5 service nova] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-214fd8d7-9fd4-4e68-8721-c78baf029903 req-fd8bbf36-aaba-42a7-9eaf-ffda2eaba9d5 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] No waiting events found dispatching network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:24 user nova-compute[75215]: WARNING nova.compute.manager [req-214fd8d7-9fd4-4e68-8721-c78baf029903 req-fd8bbf36-aaba-42a7-9eaf-ffda2eaba9d5 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received unexpected event network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 for instance with vm_state building and task_state spawning.
Nov 11 01:37:24 user nova-compute[75215]: INFO nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 11 01:37:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:37:24 user nova-compute[75215]: INFO nova.compute.manager [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Took 7.31 seconds to build instance.
Nov 11 01:37:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-776cd385-c691-437b-ac7d-d4239fb05eb2 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.429s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lazy-loading 'flavor' on Instance uuid b58b0c19-8c8a-482b-a693-eb6855ed5dd1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:37:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ae905ca4-8304-4704-8bee-e0549954262f tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:51 user nova-compute[75215]: INFO nova.compute.manager [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Terminating instance
Nov 11 01:37:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-d84220c7-e55e-40eb-b00c-40d8bff0230c req-1c6e8bb2-79a6-4bf6-894c-9c91876bfd95 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received event network-vif-unplugged-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d84220c7-e55e-40eb-b00c-40d8bff0230c req-1c6e8bb2-79a6-4bf6-894c-9c91876bfd95 service nova] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d84220c7-e55e-40eb-b00c-40d8bff0230c req-1c6e8bb2-79a6-4bf6-894c-9c91876bfd95 service nova] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d84220c7-e55e-40eb-b00c-40d8bff0230c req-1c6e8bb2-79a6-4bf6-894c-9c91876bfd95 service nova] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-d84220c7-e55e-40eb-b00c-40d8bff0230c req-1c6e8bb2-79a6-4bf6-894c-9c91876bfd95 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] No waiting events found dispatching network-vif-unplugged-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-d84220c7-e55e-40eb-b00c-40d8bff0230c req-1c6e8bb2-79a6-4bf6-894c-9c91876bfd95 service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received event network-vif-unplugged-7b29616a-00a0-4643-b438-b923d6713538 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:37:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Instance destroyed successfully.
Nov 11 01:37:52 user nova-compute[75215]: DEBUG nova.objects.instance [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lazy-loading 'resources' on Instance uuid ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1924519002',display_name='tempest-VolumesAdminNegativeTest-server-1924519002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1924519002',id=6,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKH/v8XOzhZRJ2sCHE7hOYk3rv0FltctQ9glr5yYhh/Yi+Wn4NgqMTE67p1x9TaGqKerrRxT17OniCfwhatJ/Yy/Pg/bX1qWukSN399Hx4EF/3ghnJ1qRTzTohyFoOltpQ==',key_name='tempest-keypair-1905672387',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9edee432deba4b9fa073619e1f9d99bb',ramdisk_id='',reservation_id='r-xv1hx5u9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1899827326',owner_user_name='tempest-VolumesAdminNegativeTest-1899827326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80c298c7b4074bbcab91160215fb8537',uuid=ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converting VIF {"id": "7b29616a-00a0-4643-b438-b923d6713538", "address": "fa:16:3e:80:95:2d", "network": {"id": "bbb0e0c6-9768-4889-a7bc-a11da11cd956", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1673852654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9edee432deba4b9fa073619e1f9d99bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b29616a-00", "ovs_interfaceid": "7b29616a-00a0-4643-b438-b923d6713538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:95:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b29616a-00a0-4643-b438-b923d6713538,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b29616a-00') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG os_vif [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:95:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b29616a-00a0-4643-b438-b923d6713538,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b29616a-00') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b29616a-00, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a63c9f83-815f-491d-aefb-9a7c71943568) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:52 user nova-compute[75215]: INFO os_vif [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:95:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b29616a-00a0-4643-b438-b923d6713538,network=Network(bbb0e0c6-9768-4889-a7bc-a11da11cd956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b29616a-00')
Nov 11 01:37:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Deleting instance files /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14_del
Nov 11 01:37:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Deletion of /opt/stack/data/nova/instances/ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14_del complete
Nov 11 01:37:52 user nova-compute[75215]: INFO nova.compute.manager [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 11 01:37:52 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:37:52 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:37:53 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Took 0.75 seconds to deallocate network for instance.
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-0d7d3e7d-dc1c-4dba-a8af-bebee8be5dc5 req-8fb9bc30-ee3e-430a-8a5e-0b36e72f7d9d service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received event network-vif-deleted-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:53 user nova-compute[75215]: INFO nova.compute.manager [req-0d7d3e7d-dc1c-4dba-a8af-bebee8be5dc5 req-8fb9bc30-ee3e-430a-8a5e-0b36e72f7d9d service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Neutron deleted interface 7b29616a-00a0-4643-b438-b923d6713538; detaching it from the instance and deleting it from the info cache
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-0d7d3e7d-dc1c-4dba-a8af-bebee8be5dc5 req-8fb9bc30-ee3e-430a-8a5e-0b36e72f7d9d service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-0d7d3e7d-dc1c-4dba-a8af-bebee8be5dc5 req-8fb9bc30-ee3e-430a-8a5e-0b36e72f7d9d service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Detach interface failed, port_id=7b29616a-00a0-4643-b438-b923d6713538, reason: Instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:53 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Deleted allocations for instance ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:53 user nova-compute[75215]: INFO nova.compute.manager [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Terminating instance
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0c4f8afe-ef5c-446e-8f9b-304868cb23e7 tempest-VolumesAdminNegativeTest-1899827326 tempest-VolumesAdminNegativeTest-1899827326-project-member] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-de10df81-f38e-4435-9832-a69c846ac87c req-6faf99cf-74e1-4f93-8b26-7f774fe53edb service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received event network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-de10df81-f38e-4435-9832-a69c846ac87c req-6faf99cf-74e1-4f93-8b26-7f774fe53edb service nova] Acquiring lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-de10df81-f38e-4435-9832-a69c846ac87c req-6faf99cf-74e1-4f93-8b26-7f774fe53edb service nova] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-de10df81-f38e-4435-9832-a69c846ac87c req-6faf99cf-74e1-4f93-8b26-7f774fe53edb service nova] Lock "ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-de10df81-f38e-4435-9832-a69c846ac87c req-6faf99cf-74e1-4f93-8b26-7f774fe53edb service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] No waiting events found dispatching network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:53 user nova-compute[75215]: WARNING nova.compute.manager [req-de10df81-f38e-4435-9832-a69c846ac87c req-6faf99cf-74e1-4f93-8b26-7f774fe53edb service nova] [instance: ce9e3ad7-4ef8-4b9d-87b0-a4e3458d9f14] Received unexpected event network-vif-plugged-7b29616a-00a0-4643-b438-b923d6713538 for instance with vm_state deleted and task_state None.
Nov 11 01:37:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Instance destroyed successfully.
Nov 11 01:37:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lazy-loading 'resources' on Instance uuid b58b0c19-8c8a-482b-a693-eb6855ed5dd1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1552407209',display_name='tempest-TestVolumeSwap-server-1552407209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1552407209',id=10,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZJo0sytZC5IuoBSO51eVpwoSmnt6kmQDIKh8Ye5Ab0lhOxDmzwUvgsU/3gLSeO4Bk3Hsg73WxJyTs2ftetZanHF7N+fN4vPzzQKX3Kx9AopbzsbLgbFDeHBSY7NuITsQ==',key_name='tempest-keypair-1351573152',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:30:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06fec73efbde4bd5a39d6c8866695f7c',ramdisk_id='',reservation_id='r-otaf22nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-923187612',owner_user_name='tempest-TestVolumeSwap-923187612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44d25dd39a648a6b19fda84ab4f77d3',uuid=b58b0c19-8c8a-482b-a693-eb6855ed5dd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Converting VIF {"id": "21229308-4609-4594-9c02-2d5a73c7ce1d", "address": "fa:16:3e:6d:40:2c", "network": {"id": "7ab6f502-899a-46a6-9fdc-7245305ba4e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2131913567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fec73efbde4bd5a39d6c8866695f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21229308-46", "ovs_interfaceid": "21229308-4609-4594-9c02-2d5a73c7ce1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:40:2c,bridge_name='br-int',has_traffic_filtering=True,id=21229308-4609-4594-9c02-2d5a73c7ce1d,network=Network(7ab6f502-899a-46a6-9fdc-7245305ba4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21229308-46') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG os_vif [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:40:2c,bridge_name='br-int',has_traffic_filtering=True,id=21229308-4609-4594-9c02-2d5a73c7ce1d,network=Network(7ab6f502-899a-46a6-9fdc-7245305ba4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21229308-46') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21229308-46, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b149ee4-b14b-47e4-bdb2-98c99b0e9c99) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:54 user nova-compute[75215]: INFO os_vif [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:40:2c,bridge_name='br-int',has_traffic_filtering=True,id=21229308-4609-4594-9c02-2d5a73c7ce1d,network=Network(7ab6f502-899a-46a6-9fdc-7245305ba4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21229308-46')
Nov 11 01:37:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Deleting instance files /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1_del
Nov 11 01:37:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Deletion of /opt/stack/data/nova/instances/b58b0c19-8c8a-482b-a693-eb6855ed5dd1_del complete
Nov 11 01:37:54 user nova-compute[75215]: INFO nova.compute.manager [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 11 01:37:54 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:37:54 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:37:55 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:37:55 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Took 0.74 seconds to deallocate network for instance.
Nov 11 01:37:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-a8816bf0-19ab-4612-ab54-c3c8cb728024 req-5c710797-2d8b-4ae5-ba87-2e980a91077d service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received event network-vif-deleted-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:55 user nova-compute[75215]: INFO nova.compute.manager [req-a8816bf0-19ab-4612-ab54-c3c8cb728024 req-5c710797-2d8b-4ae5-ba87-2e980a91077d service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Neutron deleted interface 21229308-4609-4594-9c02-2d5a73c7ce1d; detaching it from the instance and deleting it from the info cache
Nov 11 01:37:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-a8816bf0-19ab-4612-ab54-c3c8cb728024 req-5c710797-2d8b-4ae5-ba87-2e980a91077d service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:37:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-a8816bf0-19ab-4612-ab54-c3c8cb728024 req-5c710797-2d8b-4ae5-ba87-2e980a91077d service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Detach interface failed, port_id=21229308-4609-4594-9c02-2d5a73c7ce1d, reason: Instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:37:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received event network-vif-unplugged-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] No waiting events found dispatching network-vif-unplugged-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:56 user nova-compute[75215]: WARNING nova.compute.manager [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received unexpected event network-vif-unplugged-21229308-4609-4594-9c02-2d5a73c7ce1d for instance with vm_state deleted and task_state None.
Nov 11 01:37:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received event network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] Acquiring lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] No waiting events found dispatching network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:37:56 user nova-compute[75215]: WARNING nova.compute.manager [req-c798caf3-916e-4f90-8273-31293d0c2802 req-fa54f4db-61f0-469c-9ee4-362643cc09e9 service nova] [instance: b58b0c19-8c8a-482b-a693-eb6855ed5dd1] Received unexpected event network-vif-plugged-21229308-4609-4594-9c02-2d5a73c7ce1d for instance with vm_state deleted and task_state None.
Nov 11 01:37:56 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:37:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:56 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Deleted allocations for instance b58b0c19-8c8a-482b-a693-eb6855ed5dd1
Nov 11 01:37:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c6da3d01-575f-4e53-90ec-04107edddc57 tempest-TestVolumeSwap-923187612 tempest-TestVolumeSwap-923187612-project-member] Lock "b58b0c19-8c8a-482b-a693-eb6855ed5dd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.444s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:37:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:37:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:12 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:38:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-57875c71-ee80-4cb9-b8d4-b8af6e2c760b req-08409d97-8c34-4421-bc01-2215bdf9c926 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-changed-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-57875c71-ee80-4cb9-b8d4-b8af6e2c760b req-08409d97-8c34-4421-bc01-2215bdf9c926 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Refreshing instance network info cache due to event network-changed-c546474a-e342-4eee-8398-789477c6a76d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57875c71-ee80-4cb9-b8d4-b8af6e2c760b req-08409d97-8c34-4421-bc01-2215bdf9c926 service nova] Acquiring lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57875c71-ee80-4cb9-b8d4-b8af6e2c760b req-08409d97-8c34-4421-bc01-2215bdf9c926 service nova] Acquired lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-57875c71-ee80-4cb9-b8d4-b8af6e2c760b req-08409d97-8c34-4421-bc01-2215bdf9c926 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Refreshing network info cache for port c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-57875c71-ee80-4cb9-b8d4-b8af6e2c760b req-08409d97-8c34-4421-bc01-2215bdf9c926 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updated VIF entry in instance network info cache for port c546474a-e342-4eee-8398-789477c6a76d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-57875c71-ee80-4cb9-b8d4-b8af6e2c760b req-08409d97-8c34-4421-bc01-2215bdf9c926 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-57875c71-ee80-4cb9-b8d4-b8af6e2c760b req-08409d97-8c34-4421-bc01-2215bdf9c926 service nova] Releasing lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:15 user nova-compute[75215]: INFO nova.compute.manager [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Terminating instance
Nov 11 01:38:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-2ea10bf1-867f-4d96-9b44-a9907219d745 req-c1d4a9a9-2bf1-4e23-bfe2-74a6cdcd7f31 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received event network-vif-unplugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2ea10bf1-867f-4d96-9b44-a9907219d745 req-c1d4a9a9-2bf1-4e23-bfe2-74a6cdcd7f31 service nova] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2ea10bf1-867f-4d96-9b44-a9907219d745 req-c1d4a9a9-2bf1-4e23-bfe2-74a6cdcd7f31 service nova] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2ea10bf1-867f-4d96-9b44-a9907219d745 req-c1d4a9a9-2bf1-4e23-bfe2-74a6cdcd7f31 service nova] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-2ea10bf1-867f-4d96-9b44-a9907219d745 req-c1d4a9a9-2bf1-4e23-bfe2-74a6cdcd7f31 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] No waiting events found dispatching network-vif-unplugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:38:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-2ea10bf1-867f-4d96-9b44-a9907219d745 req-c1d4a9a9-2bf1-4e23-bfe2-74a6cdcd7f31 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received event network-vif-unplugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:38:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:38:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7880MB free_disk=25.429115295410156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Instance destroyed successfully.
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lazy-loading 'resources' on Instance uuid 29f1747f-8209-4d8f-9929-d6227763b5c5 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-827548124',display_name='tempest-ServerActionsTestOtherB-server-827548124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-827548124',id=2,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU+LVdAVbavG+XDnmduqLHiTT53kL3rXZl6lB1qlgCBq2vDQATnb3Mfb6qv4iKSMk6lmGgM+C/2DEQRENP7V1VA9I9aAAHA9et2JIQVa1XfuT4GioCqObY3JlTc/6ZLlw==',key_name='tempest-keypair-1395820682',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='001c51cb81da454b931d9ede62e34564',ramdisk_id='',reservation_id='r-ew2ngte6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-277602743',owner_user_name='tempest-ServerActionsTestOtherB-277602743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55650e69ce924b388eb12cb397127576',uuid=29f1747f-8209-4d8f-9929-d6227763b5c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Converting VIF {"id": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "address": "fa:16:3e:8d:bb:36", "network": {"id": "ed776f62-57b5-44f3-8f4c-31761a1f071c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-794266299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "001c51cb81da454b931d9ede62e34564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2771b3b6-14", "ovs_interfaceid": "2771b3b6-1454-4fae-bfc8-3c1c803324b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=2771b3b6-1454-4fae-bfc8-3c1c803324b0,network=Network(ed776f62-57b5-44f3-8f4c-31761a1f071c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2771b3b6-14') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG os_vif [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=2771b3b6-1454-4fae-bfc8-3c1c803324b0,network=Network(ed776f62-57b5-44f3-8f4c-31761a1f071c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2771b3b6-14') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2771b3b6-14, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d845a997-291d-49ea-aaff-92dbc3e960d7) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:16 user nova-compute[75215]: INFO os_vif [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=2771b3b6-1454-4fae-bfc8-3c1c803324b0,network=Network(ed776f62-57b5-44f3-8f4c-31761a1f071c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2771b3b6-14')
Nov 11 01:38:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Deleting instance files /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5_del
Nov 11 01:38:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Deletion of /opt/stack/data/nova/instances/29f1747f-8209-4d8f-9929-d6227763b5c5_del complete
Nov 11 01:38:16 user nova-compute[75215]: INFO nova.compute.manager [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 11 01:38:16 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f1747f-8209-4d8f-9929-d6227763b5c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7c0050d8-917e-4c39-848d-4f1370956954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:38:16 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:38:17 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:38:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:38:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:17 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:17 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Took 0.96 seconds to deallocate network for instance.
Nov 11 01:38:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:38:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-e2863eef-36a0-4d0c-a0b5-5e42b17543be req-a45b6a11-fed7-4717-873d-d85731af6688 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received event network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e2863eef-36a0-4d0c-a0b5-5e42b17543be req-a45b6a11-fed7-4717-873d-d85731af6688 service nova] Acquiring lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e2863eef-36a0-4d0c-a0b5-5e42b17543be req-a45b6a11-fed7-4717-873d-d85731af6688 service nova] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e2863eef-36a0-4d0c-a0b5-5e42b17543be req-a45b6a11-fed7-4717-873d-d85731af6688 service nova] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-e2863eef-36a0-4d0c-a0b5-5e42b17543be req-a45b6a11-fed7-4717-873d-d85731af6688 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] No waiting events found dispatching network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:38:18 user nova-compute[75215]: WARNING nova.compute.manager [req-e2863eef-36a0-4d0c-a0b5-5e42b17543be req-a45b6a11-fed7-4717-873d-d85731af6688 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received unexpected event network-vif-plugged-2771b3b6-1454-4fae-bfc8-3c1c803324b0 for instance with vm_state deleted and task_state None.
Nov 11 01:38:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-e2863eef-36a0-4d0c-a0b5-5e42b17543be req-a45b6a11-fed7-4717-873d-d85731af6688 service nova] [instance: 29f1747f-8209-4d8f-9929-d6227763b5c5] Received event network-vif-deleted-2771b3b6-1454-4fae-bfc8-3c1c803324b0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:38:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:18 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Deleted allocations for instance 29f1747f-8209-4d8f-9929-d6227763b5c5
Nov 11 01:38:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d0e2f314-6b91-4103-a38c-43a292944e05 tempest-ServerActionsTestOtherB-277602743 tempest-ServerActionsTestOtherB-277602743-project-member] Lock "29f1747f-8209-4d8f-9929-d6227763b5c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:38:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:38:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:22 user nova-compute[75215]: INFO nova.compute.manager [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Shelving
Nov 11 01:38:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-ee3b368d-a10e-42b3-912c-b6009c68af59 req-b09baef5-e6ec-4eaf-aed6-6da3b46d6800 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-vif-unplugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee3b368d-a10e-42b3-912c-b6009c68af59 req-b09baef5-e6ec-4eaf-aed6-6da3b46d6800 service nova] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee3b368d-a10e-42b3-912c-b6009c68af59 req-b09baef5-e6ec-4eaf-aed6-6da3b46d6800 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee3b368d-a10e-42b3-912c-b6009c68af59 req-b09baef5-e6ec-4eaf-aed6-6da3b46d6800 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-ee3b368d-a10e-42b3-912c-b6009c68af59 req-b09baef5-e6ec-4eaf-aed6-6da3b46d6800 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] No waiting events found dispatching network-vif-unplugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:38:23 user nova-compute[75215]: WARNING nova.compute.manager [req-ee3b368d-a10e-42b3-912c-b6009c68af59 req-b09baef5-e6ec-4eaf-aed6-6da3b46d6800 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received unexpected event network-vif-unplugged-c546474a-e342-4eee-8398-789477c6a76d for instance with vm_state active and task_state shelving.
Nov 11 01:38:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance destroyed successfully.
Nov 11 01:38:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Beginning cold snapshot process
Nov 11 01:38:23 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:38:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk /opt/stack/data/nova/instances/snapshots/tmp8k_luf02/b5137e8da2164ee09a287299f4a498a3 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk /opt/stack/data/nova/instances/snapshots/tmp8k_luf02/b5137e8da2164ee09a287299f4a498a3" returned: 0 in 0.519s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Snapshot extracted, beginning image upload
Nov 11 01:38:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-b707702c-ac21-49db-bfd9-ed73c01297d7 req-bd5efea3-cb76-4ef9-acb1-13360ef577f8 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b707702c-ac21-49db-bfd9-ed73c01297d7 req-bd5efea3-cb76-4ef9-acb1-13360ef577f8 service nova] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b707702c-ac21-49db-bfd9-ed73c01297d7 req-bd5efea3-cb76-4ef9-acb1-13360ef577f8 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b707702c-ac21-49db-bfd9-ed73c01297d7 req-bd5efea3-cb76-4ef9-acb1-13360ef577f8 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-b707702c-ac21-49db-bfd9-ed73c01297d7 req-bd5efea3-cb76-4ef9-acb1-13360ef577f8 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] No waiting events found dispatching network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:38:25 user nova-compute[75215]: WARNING nova.compute.manager [req-b707702c-ac21-49db-bfd9-ed73c01297d7 req-bd5efea3-cb76-4ef9-acb1-13360ef577f8 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received unexpected event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 01:38:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:27 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Snapshot image upload complete
Nov 11 01:38:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:38:27 user nova-compute[75215]: INFO nova.compute.manager [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Shelve offloading
Nov 11 01:38:27 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance destroyed successfully.
Nov 11 01:38:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:38:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquired lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:38:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Releasing lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance destroyed successfully.
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.objects.instance [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'resources' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-50013957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-50013957',id=16,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQho/bCGrdZjcyqN99hrRAj160xs5F2vrlEMeo4CuZhGRjtH+zSm55GqZ4SsRaTZmKJMk/2U6gXbQDYUX/BJ4mNp2SiIyVFBV9BEnjC2HItbMPv+SwGDbBUux0PjTK0Uw==',key_name='tempest-keypair-118414557',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:36:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-fj250k7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member',shelved_at='2023-11-11T01:38:27.055224',shelved_host='user',shelved_image_id='e467fb72-9153-4fa5-a6d2-ed58f69cba85'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=c26d1d9c-4086-4d2a-9551-b1c4b388b0ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG os_vif [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc546474a-e3, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-93904f2b-5b28-46da-9554-39a08113088f req-423785ba-e66f-4985-9895-8b5fed452a0d service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-changed-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-93904f2b-5b28-46da-9554-39a08113088f req-423785ba-e66f-4985-9895-8b5fed452a0d service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Refreshing instance network info cache due to event network-changed-c546474a-e342-4eee-8398-789477c6a76d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-93904f2b-5b28-46da-9554-39a08113088f req-423785ba-e66f-4985-9895-8b5fed452a0d service nova] Acquiring lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-93904f2b-5b28-46da-9554-39a08113088f req-423785ba-e66f-4985-9895-8b5fed452a0d service nova] Acquired lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-93904f2b-5b28-46da-9554-39a08113088f req-423785ba-e66f-4985-9895-8b5fed452a0d service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Refreshing network info cache for port c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f2a7c72-8446-43a9-986d-c6241883d1a0) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:28 user nova-compute[75215]: INFO os_vif [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3')
Nov 11 01:38:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Deleting instance files /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea_del
Nov 11 01:38:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Deletion of /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea_del complete
Nov 11 01:38:28 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Deleted allocations for instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea
Nov 11 01:38:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.objects.instance [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'numa_topology' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.objects.base [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<c26d1d9c-4086-4d2a-9551-b1c4b388b0ea> lazy-loaded attributes: resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-93904f2b-5b28-46da-9554-39a08113088f req-423785ba-e66f-4985-9895-8b5fed452a0d service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updated VIF entry in instance network info cache for port c546474a-e342-4eee-8398-789477c6a76d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-93904f2b-5b28-46da-9554-39a08113088f req-423785ba-e66f-4985-9895-8b5fed452a0d service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc546474a-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-93904f2b-5b28-46da-9554-39a08113088f req-423785ba-e66f-4985-9895-8b5fed452a0d service nova] Releasing lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fca6bf46-eedc-4423-ad8f-8decb4de1366 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.188s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:38:31 user nova-compute[75215]: INFO nova.compute.claims [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Claim successful on node user
Nov 11 01:38:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:38:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:38:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:38:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:38:31 user nova-compute[75215]: INFO nova.virt.block_device [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Booting with volume 163ae624-3d5a-43ba-af71-dd8c20b00de4 at /dev/vda
Nov 11 01:38:32 user nova-compute[75215]: DEBUG os_brick.utils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG nova.policy [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '931b9fe1dbdb4a9ebf7419627df1e6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc975a9ec00422abc485cd279c4aa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1891c689-8371-4540-8ee3-1a58b1ef9a08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[95973fdb-572a-4bc5-ac63-643d94c367db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e3918-cfea-442e-97e0-cb811fed2b87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d365306d-f05b-4ed7-bfed-eeec19fe18d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:38:32 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:38:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a4110-ce88-4df5-b789-ef74d08f1308]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG os_brick.utils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating existing volume attachment record: 9faff6b0-5878-426a-98fa-8e04ab3fcdd4 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:38:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully created port: a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:38:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully created port: c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:38:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully created port: 2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:38:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully created port: 83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:38:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully created port: 58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:38:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully updated port: a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:38:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-62eea298-1dd8-43d9-8457-5a6720e2eec4 req-98b99140-3830-45ff-b9f4-4a59a1a40b58 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-changed-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-62eea298-1dd8-43d9-8457-5a6720e2eec4 req-98b99140-3830-45ff-b9f4-4a59a1a40b58 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing instance network info cache due to event network-changed-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-62eea298-1dd8-43d9-8457-5a6720e2eec4 req-98b99140-3830-45ff-b9f4-4a59a1a40b58 service nova] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-62eea298-1dd8-43d9-8457-5a6720e2eec4 req-98b99140-3830-45ff-b9f4-4a59a1a40b58 service nova] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-62eea298-1dd8-43d9-8457-5a6720e2eec4 req-98b99140-3830-45ff-b9f4-4a59a1a40b58 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing network info cache for port a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-62eea298-1dd8-43d9-8457-5a6720e2eec4 req-98b99140-3830-45ff-b9f4-4a59a1a40b58 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:38:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-62eea298-1dd8-43d9-8457-5a6720e2eec4 req-98b99140-3830-45ff-b9f4-4a59a1a40b58 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-62eea298-1dd8-43d9-8457-5a6720e2eec4 req-98b99140-3830-45ff-b9f4-4a59a1a40b58 service nova] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully updated port: 0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:38:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully updated port: e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:38:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-changed-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing instance network info cache due to event network-changed-0fa80abb-2866-47dd-b1cb-4189d05d05c1. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing network info cache for port 0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-changed-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing instance network info cache due to event network-changed-e4bac6a4-a934-4780-9e9e-d17626b43ba9. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing network info cache for port e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully updated port: c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7be63f56-73f2-4d2a-ad7a-192b179ca3ae req-ad0343b5-5dda-4824-b3f1-18405df8e4e9 service nova] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully updated port: 2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully updated port: 83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-changed-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing instance network info cache due to event network-changed-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing network info cache for port c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:39 user nova-compute[75215]: INFO nova.compute.manager [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Detaching volume 7ab170cd-205e-489c-99c2-03f6a32873e7
Nov 11 01:38:40 user nova-compute[75215]: INFO nova.virt.block_device [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Attempting to driver detach volume 7ab170cd-205e-489c-99c2-03f6a32873e7 from mountpoint /dev/vdb
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Attempting to detach device vdb from instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:38:40 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:38:40 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:38:40 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:38:40 user nova-compute[75215]:   <serial>7ab170cd-205e-489c-99c2-03f6a32873e7</serial>
Nov 11 01:38:40 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 01:38:40 user nova-compute[75215]: </disk>
Nov 11 01:38:40 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:38:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully detached device vdb from instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 from the persistent domain config.
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:38:40 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:38:40 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:38:40 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:38:40 user nova-compute[75215]:   <serial>7ab170cd-205e-489c-99c2-03f6a32873e7</serial>
Nov 11 01:38:40 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 01:38:40 user nova-compute[75215]: </disk>
Nov 11 01:38:40 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-changed-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing instance network info cache due to event network-changed-2166c0c2-1f64-4b1f-a947-6e269e5d682a. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing network info cache for port 2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-changed-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing instance network info cache due to event network-changed-83e59e94-7503-4236-b69f-c1b289c3f4a0. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing network info cache for port 83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Successfully updated port: 58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cd90a08-abcc-4f14-be58-21ada98a91f1 req-2d0d49aa-b848-49be-a0b8-9f0096de0805 service nova] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-196a643a-7b85-4fba-919c-39201e4fcb2a req-65aca953-87b1-4a5c-91dc-f494f0a5e218 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-changed-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-196a643a-7b85-4fba-919c-39201e4fcb2a req-65aca953-87b1-4a5c-91dc-f494f0a5e218 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing instance network info cache due to event network-changed-58ba476f-668b-445a-b5f0-98e63a1d665f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-196a643a-7b85-4fba-919c-39201e4fcb2a req-65aca953-87b1-4a5c-91dc-f494f0a5e218 service nova] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [{"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance network_info: |[{"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-196a643a-7b85-4fba-919c-39201e4fcb2a req-65aca953-87b1-4a5c-91dc-f494f0a5e218 service nova] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-196a643a-7b85-4fba-919c-39201e4fcb2a req-65aca953-87b1-4a5c-91dc-f494f0a5e218 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing network info cache for port 58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-196a643a-7b85-4fba-919c-39201e4fcb2a req-65aca953-87b1-4a5c-91dc-f494f0a5e218 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updated VIF entry in instance network info cache for port 58ba476f-668b-445a-b5f0-98e63a1d665f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-196a643a-7b85-4fba-919c-39201e4fcb2a req-65aca953-87b1-4a5c-91dc-f494f0a5e218 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [{"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-196a643a-7b85-4fba-919c-39201e4fcb2a req-65aca953-87b1-4a5c-91dc-f494f0a5e218 service nova] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:38:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:38:49 user nova-compute[75215]: INFO nova.compute.claims [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Claim successful on node user
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:38:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.policy [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '561ad55121d44be1ab7971a495b9347f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32564a70b861419eaefcb97cd327088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:38:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Creating image(s)
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "/opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "/opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "/opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk 1073741824" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Successfully created port: fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Cannot resize image /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Ensure instance console log exists: /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Successfully updated port: fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquired lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-a1242217-9777-445a-bd20-5f0ea2816bcc req-3759a7b7-1b3d-40f1-b4ca-31d2456c6780 service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received event network-changed-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-a1242217-9777-445a-bd20-5f0ea2816bcc req-3759a7b7-1b3d-40f1-b4ca-31d2456c6780 service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Refreshing instance network info cache due to event network-changed-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1242217-9777-445a-bd20-5f0ea2816bcc req-3759a7b7-1b3d-40f1-b4ca-31d2456c6780 service nova] Acquiring lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:38:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Updating instance_info_cache with network_info: [{"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Releasing lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Instance network_info: |[{"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1242217-9777-445a-bd20-5f0ea2816bcc req-3759a7b7-1b3d-40f1-b4ca-31d2456c6780 service nova] Acquired lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1242217-9777-445a-bd20-5f0ea2816bcc req-3759a7b7-1b3d-40f1-b4ca-31d2456c6780 service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Refreshing network info cache for port fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Start _get_guest_xml network_info=[{"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:38:52 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:38:52 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714858079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714858079',id=20,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-kc4fg0ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:50Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=473f1cfa-fcac-4d21-99ee-bdb8140c315e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:39:d5,bridge_name='br-int',has_traffic_filtering=True,id=fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcacb3e5-47') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'pci_devices' on Instance uuid 473f1cfa-fcac-4d21-99ee-bdb8140c315e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:38:52 user nova-compute[75215]:   <uuid>473f1cfa-fcac-4d21-99ee-bdb8140c315e</uuid>
Nov 11 01:38:52 user nova-compute[75215]:   <name>instance-00000014</name>
Nov 11 01:38:52 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:38:52 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:38:52 user nova-compute[75215]:   <metadata>
Nov 11 01:38:52 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:38:52 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:38:52 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-714858079</nova:name>
Nov 11 01:38:52 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:38:52</nova:creationTime>
Nov 11 01:38:52 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:38:52 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:38:52 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:38:52 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:38:52 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:38:52 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:38:52 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:38:52 user nova-compute[75215]:       <nova:owner>
Nov 11 01:38:52 user nova-compute[75215]:         <nova:user uuid="561ad55121d44be1ab7971a495b9347f">tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member</nova:user>
Nov 11 01:38:52 user nova-compute[75215]:         <nova:project uuid="32564a70b861419eaefcb97cd327088d">tempest-ServerBootFromVolumeStableRescueTest-1327607516</nova:project>
Nov 11 01:38:52 user nova-compute[75215]:       </nova:owner>
Nov 11 01:38:52 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:38:52 user nova-compute[75215]:       <nova:ports>
Nov 11 01:38:52 user nova-compute[75215]:         <nova:port uuid="fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8">
Nov 11 01:38:52 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 01:38:52 user nova-compute[75215]:         </nova:port>
Nov 11 01:38:52 user nova-compute[75215]:       </nova:ports>
Nov 11 01:38:52 user nova-compute[75215]:     </nova:instance>
Nov 11 01:38:52 user nova-compute[75215]:   </metadata>
Nov 11 01:38:52 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:38:52 user nova-compute[75215]:     <system>
Nov 11 01:38:52 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:38:52 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:38:52 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:38:52 user nova-compute[75215]:       <entry name="serial">473f1cfa-fcac-4d21-99ee-bdb8140c315e</entry>
Nov 11 01:38:52 user nova-compute[75215]:       <entry name="uuid">473f1cfa-fcac-4d21-99ee-bdb8140c315e</entry>
Nov 11 01:38:52 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:38:52 user nova-compute[75215]:     </system>
Nov 11 01:38:52 user nova-compute[75215]:   </sysinfo>
Nov 11 01:38:52 user nova-compute[75215]:   <os>
Nov 11 01:38:52 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:38:52 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:38:52 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:38:52 user nova-compute[75215]:   </os>
Nov 11 01:38:52 user nova-compute[75215]:   <features>
Nov 11 01:38:52 user nova-compute[75215]:     <acpi/>
Nov 11 01:38:52 user nova-compute[75215]:     <apic/>
Nov 11 01:38:52 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:38:52 user nova-compute[75215]:   </features>
Nov 11 01:38:52 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:38:52 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:38:52 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:38:52 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:38:52 user nova-compute[75215]:   </clock>
Nov 11 01:38:52 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:38:52 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:38:52 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:38:52 user nova-compute[75215]:   </cpu>
Nov 11 01:38:52 user nova-compute[75215]:   <devices>
Nov 11 01:38:52 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:38:52 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:38:52 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk"/>
Nov 11 01:38:52 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:38:52 user nova-compute[75215]:     </disk>
Nov 11 01:38:52 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:38:52 user nova-compute[75215]:       <mac address="fa:16:3e:e8:39:d5"/>
Nov 11 01:38:52 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:38:52 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:38:52 user nova-compute[75215]:       <target dev="tapfcacb3e5-47"/>
Nov 11 01:38:52 user nova-compute[75215]:     </interface>
Nov 11 01:38:52 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:38:52 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/console.log" append="off"/>
Nov 11 01:38:52 user nova-compute[75215]:     </serial>
Nov 11 01:38:52 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:38:52 user nova-compute[75215]:     <video>
Nov 11 01:38:52 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:38:52 user nova-compute[75215]:     </video>
Nov 11 01:38:52 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:38:52 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:38:52 user nova-compute[75215]:     </rng>
Nov 11 01:38:52 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:38:52 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:38:52 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:38:52 user nova-compute[75215]:     </memballoon>
Nov 11 01:38:52 user nova-compute[75215]:   </devices>
Nov 11 01:38:52 user nova-compute[75215]: </domain>
Nov 11 01:38:52 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714858079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714858079',id=20,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-kc4fg0ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:50Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=473f1cfa-fcac-4d21-99ee-bdb8140c315e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:39:d5,bridge_name='br-int',has_traffic_filtering=True,id=fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcacb3e5-47') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG os_vif [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:39:d5,bridge_name='br-int',has_traffic_filtering=True,id=fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcacb3e5-47') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e26be1ed-2937-5a42-bd47-9a61dbb81afd', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcacb3e5-47, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcacb3e5-47, col_values=(('qos', UUID('85a486bc-4b5e-452c-aede-c7d1a2b69236')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcacb3e5-47, col_values=(('external_ids', {'iface-id': 'fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:39:d5', 'vm-uuid': '473f1cfa-fcac-4d21-99ee-bdb8140c315e'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:52 user nova-compute[75215]: INFO os_vif [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:39:d5,bridge_name='br-int',has_traffic_filtering=True,id=fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcacb3e5-47')
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No VIF found with MAC fa:16:3e:e8:39:d5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1242217-9777-445a-bd20-5f0ea2816bcc req-3759a7b7-1b3d-40f1-b4ca-31d2456c6780 service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Updated VIF entry in instance network info cache for port fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-a1242217-9777-445a-bd20-5f0ea2816bcc req-3759a7b7-1b3d-40f1-b4ca-31d2456c6780 service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Updating instance_info_cache with network_info: [{"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:38:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a1242217-9777-445a-bd20-5f0ea2816bcc req-3759a7b7-1b3d-40f1-b4ca-31d2456c6780 service nova] Releasing lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-6c2ae231-ea8d-4748-916c-29489f56b5da req-825b3c51-c82e-484e-b124-69ccff7870e4 service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received event network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6c2ae231-ea8d-4748-916c-29489f56b5da req-825b3c51-c82e-484e-b124-69ccff7870e4 service nova] Acquiring lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6c2ae231-ea8d-4748-916c-29489f56b5da req-825b3c51-c82e-484e-b124-69ccff7870e4 service nova] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6c2ae231-ea8d-4748-916c-29489f56b5da req-825b3c51-c82e-484e-b124-69ccff7870e4 service nova] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-6c2ae231-ea8d-4748-916c-29489f56b5da req-825b3c51-c82e-484e-b124-69ccff7870e4 service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] No waiting events found dispatching network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:38:54 user nova-compute[75215]: WARNING nova.compute.manager [req-6c2ae231-ea8d-4748-916c-29489f56b5da req-825b3c51-c82e-484e-b124-69ccff7870e4 service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received unexpected event network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 for instance with vm_state building and task_state spawning.
Nov 11 01:38:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-6d27ff9c-1eb6-4bbf-b99c-37ae360baa99 req-54147889-35ec-468d-bf3d-876edf0daa0a service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received event network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6d27ff9c-1eb6-4bbf-b99c-37ae360baa99 req-54147889-35ec-468d-bf3d-876edf0daa0a service nova] Acquiring lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6d27ff9c-1eb6-4bbf-b99c-37ae360baa99 req-54147889-35ec-468d-bf3d-876edf0daa0a service nova] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6d27ff9c-1eb6-4bbf-b99c-37ae360baa99 req-54147889-35ec-468d-bf3d-876edf0daa0a service nova] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-6d27ff9c-1eb6-4bbf-b99c-37ae360baa99 req-54147889-35ec-468d-bf3d-876edf0daa0a service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] No waiting events found dispatching network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:38:56 user nova-compute[75215]: WARNING nova.compute.manager [req-6d27ff9c-1eb6-4bbf-b99c-37ae360baa99 req-54147889-35ec-468d-bf3d-876edf0daa0a service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received unexpected event network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 for instance with vm_state building and task_state spawning.
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:38:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Instance spawned successfully.
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:38:56 user nova-compute[75215]: INFO nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 11 01:38:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:38:56 user nova-compute[75215]: INFO nova.compute.manager [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Took 7.15 seconds to build instance.
Nov 11 01:38:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ceebc33-8296-496e-853b-07d7af616940 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.267s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:38:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:38:59 user nova-compute[75215]: INFO nova.virt.block_device [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Booting with volume 9070f744-84b7-47eb-a525-c7b150fa166e at /dev/vdb
Nov 11 01:38:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcac1cc-146c-4300-952e-bd8b24f948d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc8fb0b-b871-4e13-b533-0b0bb4f7be37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3243b859-3ffb-4df1-bc50-5a2616e1ee21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3228bd19-42cb-4075-a0f3-e422524a8894]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:38:59 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:38:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a7593-8dc2-40b6-8442-ba2efcb31ae1]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG os_brick.utils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:38:59 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating existing volume attachment record: 4e1eb48c-15b3-4eec-aa2b-f62bed347be7 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:39:00 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 is timed out.
Nov 11 01:39:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully detached device vdb from instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 from the live domain config.
Nov 11 01:39:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmYkatCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:39:00 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2e1453-aa3a-4598-940e-a200570ea0f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:39:00 user nova-compute[75215]: No targets found.
Nov 11 01:39:00 user nova-compute[75215]: iSNS:
Nov 11 01:39:00 user nova-compute[75215]: No targets found.
Nov 11 01:39:00 user nova-compute[75215]: STATIC:
Nov 11 01:39:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:39:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:39:00 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:39:00 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7
Nov 11 01:39:00 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:39:00 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:39:00 user nova-compute[75215]: FIRMWARE:
Nov 11 01:39:00 user nova-compute[75215]: No targets found.
Nov 11 01:39:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:39:00 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:39:00 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc004269-7a2e-407a-9813-f6eb368534be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3676d6-841a-4526-8794-02140de1355b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:39:00 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:39:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:39:00 user nova-compute[75215]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 (non-flash)
Nov 11 01:39:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40444d70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68052d-8396-4869-8d1e-50700bc6b764]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad15e221-9ad7-4ea1-aadb-21d253bbb658]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0151195-4f15-414a-932d-eda39f2f6ae3]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b2738c-5211-4163-b7c9-aab370260d87]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b40804-dd0e-4681-a6fb-e8fc08202b76]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a01d9e-bf1d-4a99-af81-6b0cf7ee3fca]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260]
Nov 11 01:39:00 user nova-compute[75215]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7, portal: 172.16.0.220,3260] successful.
Nov 11 01:39:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab170cd-205e-489c-99c2-03f6a32873e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d18335-9231-4032-ae4b-f780987a8843]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== disconnect_volume: return (352ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:39:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:39:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:39:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquired lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:39:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:39:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'info_cache' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:07 user nova-compute[75215]: DEBUG nova.objects.base [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:39:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Releasing lock "refresh_cache-29f5d275-78e7-4292-98c8-d12f47f28fbf" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:39:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance destroyed successfully.
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'resources' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG os_vif [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fd51c5f-2f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a2fad1a-71db-44cc-ac26-243b2fb61bee) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: INFO os_vif [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f')
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Start _get_guest_xml network_info=[{"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'numa_topology' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:39:08 user nova-compute[75215]: INFO nova.compute.manager [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Terminating instance
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:39:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:39:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'vcpu_model' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'pci_devices' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:39:08 user nova-compute[75215]:   <uuid>29f5d275-78e7-4292-98c8-d12f47f28fbf</uuid>
Nov 11 01:39:08 user nova-compute[75215]:   <name>instance-00000004</name>
Nov 11 01:39:08 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:39:08 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:39:08 user nova-compute[75215]:   <metadata>
Nov 11 01:39:08 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:39:08 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:39:08 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeTestJSON-server-1742806291</nova:name>
Nov 11 01:39:08 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:39:08</nova:creationTime>
Nov 11 01:39:08 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:39:08 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:39:08 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:39:08 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:39:08 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:39:08 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:39:08 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:39:08 user nova-compute[75215]:       <nova:owner>
Nov 11 01:39:08 user nova-compute[75215]:         <nova:user uuid="285cd483fbdc4e4faec7a1bbd414ca7f">tempest-AttachVolumeTestJSON-1999559004-project-member</nova:user>
Nov 11 01:39:08 user nova-compute[75215]:         <nova:project uuid="f71c4317ced540a1a841f41cb9929b7b">tempest-AttachVolumeTestJSON-1999559004</nova:project>
Nov 11 01:39:08 user nova-compute[75215]:       </nova:owner>
Nov 11 01:39:08 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:39:08 user nova-compute[75215]:       <nova:ports>
Nov 11 01:39:08 user nova-compute[75215]:         <nova:port uuid="9fd51c5f-2f3b-4df5-92c8-3d84fe37691b">
Nov 11 01:39:08 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:39:08 user nova-compute[75215]:         </nova:port>
Nov 11 01:39:08 user nova-compute[75215]:       </nova:ports>
Nov 11 01:39:08 user nova-compute[75215]:     </nova:instance>
Nov 11 01:39:08 user nova-compute[75215]:   </metadata>
Nov 11 01:39:08 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:39:08 user nova-compute[75215]:     <system>
Nov 11 01:39:08 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:39:08 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:39:08 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:39:08 user nova-compute[75215]:       <entry name="serial">29f5d275-78e7-4292-98c8-d12f47f28fbf</entry>
Nov 11 01:39:08 user nova-compute[75215]:       <entry name="uuid">29f5d275-78e7-4292-98c8-d12f47f28fbf</entry>
Nov 11 01:39:08 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:39:08 user nova-compute[75215]:     </system>
Nov 11 01:39:08 user nova-compute[75215]:   </sysinfo>
Nov 11 01:39:08 user nova-compute[75215]:   <os>
Nov 11 01:39:08 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:39:08 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:39:08 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:39:08 user nova-compute[75215]:   </os>
Nov 11 01:39:08 user nova-compute[75215]:   <features>
Nov 11 01:39:08 user nova-compute[75215]:     <acpi/>
Nov 11 01:39:08 user nova-compute[75215]:     <apic/>
Nov 11 01:39:08 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:39:08 user nova-compute[75215]:   </features>
Nov 11 01:39:08 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:39:08 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:39:08 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:39:08 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:39:08 user nova-compute[75215]:   </clock>
Nov 11 01:39:08 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:39:08 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:39:08 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:39:08 user nova-compute[75215]:   </cpu>
Nov 11 01:39:08 user nova-compute[75215]:   <devices>
Nov 11 01:39:08 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:39:08 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:39:08 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk"/>
Nov 11 01:39:08 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:39:08 user nova-compute[75215]:     </disk>
Nov 11 01:39:08 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:39:08 user nova-compute[75215]:       <mac address="fa:16:3e:7e:c3:e5"/>
Nov 11 01:39:08 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:39:08 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:39:08 user nova-compute[75215]:       <target dev="tap9fd51c5f-2f"/>
Nov 11 01:39:08 user nova-compute[75215]:     </interface>
Nov 11 01:39:08 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:39:08 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/console.log" append="off"/>
Nov 11 01:39:08 user nova-compute[75215]:     </serial>
Nov 11 01:39:08 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:39:08 user nova-compute[75215]:     <video>
Nov 11 01:39:08 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:39:08 user nova-compute[75215]:     </video>
Nov 11 01:39:08 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:39:08 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:39:08 user nova-compute[75215]:     </rng>
Nov 11 01:39:08 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:39:08 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:39:08 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:39:08 user nova-compute[75215]:     </memballoon>
Nov 11 01:39:08 user nova-compute[75215]:   </devices>
Nov 11 01:39:08 user nova-compute[75215]: </domain>
Nov 11 01:39:08 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-b9a5df9c-4108-4177-8e5a-bfcf3393f449 req-84498885-5517-4290-a99b-3f98e75d30c3 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received event network-vif-unplugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b9a5df9c-4108-4177-8e5a-bfcf3393f449 req-84498885-5517-4290-a99b-3f98e75d30c3 service nova] Acquiring lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b9a5df9c-4108-4177-8e5a-bfcf3393f449 req-84498885-5517-4290-a99b-3f98e75d30c3 service nova] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b9a5df9c-4108-4177-8e5a-bfcf3393f449 req-84498885-5517-4290-a99b-3f98e75d30c3 service nova] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-b9a5df9c-4108-4177-8e5a-bfcf3393f449 req-84498885-5517-4290-a99b-3f98e75d30c3 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] No waiting events found dispatching network-vif-unplugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-b9a5df9c-4108-4177-8e5a-bfcf3393f449 req-84498885-5517-4290-a99b-3f98e75d30c3 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received event network-vif-unplugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Instance destroyed successfully.
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lazy-loading 'resources' on Instance uuid e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'trusted_certs' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-393253023',display_name='tempest-VolumesActionsTest-instance-393253023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-393253023',id=18,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:37:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28351ac5c20f4fa0be12a86bd5cd5ce9',ramdisk_id='',reservation_id='r-0vu0v8re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-979308973',owner_user_name='tempest-VolumesActionsTest-979308973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:37:25Z,user_data=None,user_id='ec2a1a4aed354d499952775c177f376f',uuid=e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converting VIF {"id": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "address": "fa:16:3e:8d:c6:4b", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524d7d2f-fe", "ovs_interfaceid": "524d7d2f-fe62-4f74-bb17-4d1df8708009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c6:4b,bridge_name='br-int',has_traffic_filtering=True,id=524d7d2f-fe62-4f74-bb17-4d1df8708009,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524d7d2f-fe') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG os_vif [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c6:4b,bridge_name='br-int',has_traffic_filtering=True,id=524d7d2f-fe62-4f74-bb17-4d1df8708009,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524d7d2f-fe') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:39:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap524d7d2f-fe, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29844d1c-e98d-43a0-99a6-45425e659db7) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: INFO os_vif [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c6:4b,bridge_name='br-int',has_traffic_filtering=True,id=524d7d2f-fe62-4f74-bb17-4d1df8708009,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524d7d2f-fe')
Nov 11 01:39:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Deleting instance files /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5_del
Nov 11 01:39:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Deletion of /opt/stack/data/nova/instances/e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5_del complete
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: INFO nova.compute.manager [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 11 01:39:09 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Cannot resize image /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'migration_context' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.objects.base [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Object Instance<29f5d275-78e7-4292-98c8-d12f47f28fbf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG os_vif [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ceffea16-bab8-5bca-9457-dc3e6e10fd5a', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fd51c5f-2f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fd51c5f-2f, col_values=(('qos', UUID('111bece6-96fa-45a6-bd65-fc894853fe72')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fd51c5f-2f, col_values=(('external_ids', {'iface-id': '9fd51c5f-2f3b-4df5-92c8-3d84fe37691b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:c3:e5', 'vm-uuid': '29f5d275-78e7-4292-98c8-d12f47f28fbf'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:09 user nova-compute[75215]: INFO os_vif [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f')
Nov 11 01:39:10 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:10 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Took 0.93 seconds to deallocate network for instance.
Nov 11 01:39:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:10 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:39:10 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:39:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:10 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Deleted allocations for instance e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5
Nov 11 01:39:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-af82042b-96c4-47e7-8f34-be11fabf8786 req-c71eca01-026f-473b-ba5e-4afc3d3cf883 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received event network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af82042b-96c4-47e7-8f34-be11fabf8786 req-c71eca01-026f-473b-ba5e-4afc3d3cf883 service nova] Acquiring lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af82042b-96c4-47e7-8f34-be11fabf8786 req-c71eca01-026f-473b-ba5e-4afc3d3cf883 service nova] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af82042b-96c4-47e7-8f34-be11fabf8786 req-c71eca01-026f-473b-ba5e-4afc3d3cf883 service nova] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-af82042b-96c4-47e7-8f34-be11fabf8786 req-c71eca01-026f-473b-ba5e-4afc3d3cf883 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] No waiting events found dispatching network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:10 user nova-compute[75215]: WARNING nova.compute.manager [req-af82042b-96c4-47e7-8f34-be11fabf8786 req-c71eca01-026f-473b-ba5e-4afc3d3cf883 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received unexpected event network-vif-plugged-524d7d2f-fe62-4f74-bb17-4d1df8708009 for instance with vm_state deleted and task_state None.
Nov 11 01:39:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-af82042b-96c4-47e7-8f34-be11fabf8786 req-c71eca01-026f-473b-ba5e-4afc3d3cf883 service nova] [instance: e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5] Received event network-vif-deleted-524d7d2f-fe62-4f74-bb17-4d1df8708009 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bba5a39f-519e-426d-bb55-b52c6fbd3341 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "e8dd6cf1-0a0a-40af-bb42-54a3ffa088c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.877s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-a36d596e-bc6d-41fb-8a84-583e00c69245 req-73bd9717-b055-4e8d-b32b-b5859fc92bd6 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a36d596e-bc6d-41fb-8a84-583e00c69245 req-73bd9717-b055-4e8d-b32b-b5859fc92bd6 service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a36d596e-bc6d-41fb-8a84-583e00c69245 req-73bd9717-b055-4e8d-b32b-b5859fc92bd6 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a36d596e-bc6d-41fb-8a84-583e00c69245 req-73bd9717-b055-4e8d-b32b-b5859fc92bd6 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-a36d596e-bc6d-41fb-8a84-583e00c69245 req-73bd9717-b055-4e8d-b32b-b5859fc92bd6 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:11 user nova-compute[75215]: WARNING nova.compute.manager [req-a36d596e-bc6d-41fb-8a84-583e00c69245 req-73bd9717-b055-4e8d-b32b-b5859fc92bd6 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state stopped and task_state powering-on.
Nov 11 01:39:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:12 user nova-compute[75215]: DEBUG nova.objects.instance [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'flavor' on Instance uuid 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-aff9a745-85d2-4730-96cf-cc6dd9b41c7a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.530s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "7c0050d8-917e-4c39-848d-4f1370956954" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "7c0050d8-917e-4c39-848d-4f1370956954" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "7c0050d8-917e-4c39-848d-4f1370956954-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:13 user nova-compute[75215]: INFO nova.compute.manager [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Terminating instance
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ab278e9-6365-4593-ba31-822af6e5c3cf req-f1114e4b-836e-4460-ab14-5e5d77f03974 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received event network-vif-unplugged-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ab278e9-6365-4593-ba31-822af6e5c3cf req-f1114e4b-836e-4460-ab14-5e5d77f03974 service nova] Acquiring lock "7c0050d8-917e-4c39-848d-4f1370956954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ab278e9-6365-4593-ba31-822af6e5c3cf req-f1114e4b-836e-4460-ab14-5e5d77f03974 service nova] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ab278e9-6365-4593-ba31-822af6e5c3cf req-f1114e4b-836e-4460-ab14-5e5d77f03974 service nova] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ab278e9-6365-4593-ba31-822af6e5c3cf req-f1114e4b-836e-4460-ab14-5e5d77f03974 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] No waiting events found dispatching network-vif-unplugged-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ab278e9-6365-4593-ba31-822af6e5c3cf req-f1114e4b-836e-4460-ab14-5e5d77f03974 service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received event network-vif-unplugged-9c301726-ca45-44b5-a9e9-ba59d72de74c for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-4694798a-7fe8-4115-ab24-8f5ce53cc0cf req-4af7c03d-64de-4a43-92b2-81cf137b2a0a service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4694798a-7fe8-4115-ab24-8f5ce53cc0cf req-4af7c03d-64de-4a43-92b2-81cf137b2a0a service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4694798a-7fe8-4115-ab24-8f5ce53cc0cf req-4af7c03d-64de-4a43-92b2-81cf137b2a0a service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4694798a-7fe8-4115-ab24-8f5ce53cc0cf req-4af7c03d-64de-4a43-92b2-81cf137b2a0a service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-4694798a-7fe8-4115-ab24-8f5ce53cc0cf req-4af7c03d-64de-4a43-92b2-81cf137b2a0a service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:13 user nova-compute[75215]: WARNING nova.compute.manager [req-4694798a-7fe8-4115-ab24-8f5ce53cc0cf req-4af7c03d-64de-4a43-92b2-81cf137b2a0a service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state stopped and task_state powering-on.
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:39:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance rebooted successfully.
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dd8030da-f6a6-4e5a-9139-45f1a2da4c4c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:39:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Instance destroyed successfully.
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lazy-loading 'resources' on Instance uuid 7c0050d8-917e-4c39-848d-4f1370956954 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-695666396',display_name='tempest-VolumesActionsTest-instance-695666396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-695666396',id=17,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:36:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a36246bf14ac41709b672152797892ec',ramdisk_id='',reservation_id='r-n66y6ndg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-602409437',owner_user_name='tempest-VolumesActionsTest-602409437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:36:59Z,user_data=None,user_id='1364d089216946da82c04a6751554063',uuid=7c0050d8-917e-4c39-848d-4f1370956954,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Converting VIF {"id": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "address": "fa:16:3e:2d:bb:b9", "network": {"id": "1dc6459e-8032-440a-998b-b8f2ad657a2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1558293626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a36246bf14ac41709b672152797892ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c301726-ca", "ovs_interfaceid": "9c301726-ca45-44b5-a9e9-ba59d72de74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=9c301726-ca45-44b5-a9e9-ba59d72de74c,network=Network(1dc6459e-8032-440a-998b-b8f2ad657a2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c301726-ca') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG os_vif [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=9c301726-ca45-44b5-a9e9-ba59d72de74c,network=Network(1dc6459e-8032-440a-998b-b8f2ad657a2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c301726-ca') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c301726-ca, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=979d3d7c-c52c-497f-976c-051f94e98019) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:13 user nova-compute[75215]: INFO os_vif [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=9c301726-ca45-44b5-a9e9-ba59d72de74c,network=Network(1dc6459e-8032-440a-998b-b8f2ad657a2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c301726-ca')
Nov 11 01:39:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Deleting instance files /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954_del
Nov 11 01:39:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Deletion of /opt/stack/data/nova/instances/7c0050d8-917e-4c39-848d-4f1370956954_del complete
Nov 11 01:39:13 user nova-compute[75215]: INFO nova.compute.manager [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Took 0.81 seconds to destroy the instance on the hypervisor.
Nov 11 01:39:13 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:39:13 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:39:14 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '7c0050d8-917e-4c39-848d-4f1370956954' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '7c0050d8-917e-4c39-848d-4f1370956954' (instance-00000011)
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:14 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Took 0.65 seconds to deallocate network for instance.
Nov 11 01:39:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.573s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:15 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Deleted allocations for instance 7c0050d8-917e-4c39-848d-4f1370956954
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-44cb3765-9f03-4459-9c6d-19500b289fff req-7d946c2b-0349-444b-ac00-f4581c496dcb service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received event network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-44cb3765-9f03-4459-9c6d-19500b289fff req-7d946c2b-0349-444b-ac00-f4581c496dcb service nova] Acquiring lock "7c0050d8-917e-4c39-848d-4f1370956954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-44cb3765-9f03-4459-9c6d-19500b289fff req-7d946c2b-0349-444b-ac00-f4581c496dcb service nova] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-44cb3765-9f03-4459-9c6d-19500b289fff req-7d946c2b-0349-444b-ac00-f4581c496dcb service nova] Lock "7c0050d8-917e-4c39-848d-4f1370956954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-44cb3765-9f03-4459-9c6d-19500b289fff req-7d946c2b-0349-444b-ac00-f4581c496dcb service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] No waiting events found dispatching network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:15 user nova-compute[75215]: WARNING nova.compute.manager [req-44cb3765-9f03-4459-9c6d-19500b289fff req-7d946c2b-0349-444b-ac00-f4581c496dcb service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received unexpected event network-vif-plugged-9c301726-ca45-44b5-a9e9-ba59d72de74c for instance with vm_state deleted and task_state None.
Nov 11 01:39:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-44cb3765-9f03-4459-9c6d-19500b289fff req-7d946c2b-0349-444b-ac00-f4581c496dcb service nova] [instance: 7c0050d8-917e-4c39-848d-4f1370956954] Received event network-vif-deleted-9c301726-ca45-44b5-a9e9-ba59d72de74c {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3c33f734-f3f3-4299-89b3-be72c53818ca tempest-VolumesActionsTest-602409437 tempest-VolumesActionsTest-602409437-project-member] Lock "7c0050d8-917e-4c39-848d-4f1370956954" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.455s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:39:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8223MB free_disk=25.407642364501953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ed9354d9-106b-4ca5-8f60-0140c85e74ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance e6560dd5-4f17-417d-bb0c-269e0284207d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:39:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:21 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:39:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:39:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:39:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:39:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:39:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:27 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:39:27 user nova-compute[75215]: INFO nova.compute.claims [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Claim successful on node user
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:39:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:39:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Creating image(s)
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "/opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "/opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "/opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG nova.policy [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94388f9dde214c389d63b78879564525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d112e660a694f1698f81fd725acb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk 1073741824" returned: 0 in 0.057s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Checking if we can resize image /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Cannot resize image /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Ensure instance console log exists: /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Successfully created port: 4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:30 user nova-compute[75215]: INFO nova.compute.manager [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Terminating instance
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-45f948fb-4d1a-47dc-bcf6-11069f688eed req-0064bee4-f8dc-47d4-aeb6-0ca41e9e7fa0 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-unplugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-45f948fb-4d1a-47dc-bcf6-11069f688eed req-0064bee4-f8dc-47d4-aeb6-0ca41e9e7fa0 service nova] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-45f948fb-4d1a-47dc-bcf6-11069f688eed req-0064bee4-f8dc-47d4-aeb6-0ca41e9e7fa0 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-45f948fb-4d1a-47dc-bcf6-11069f688eed req-0064bee4-f8dc-47d4-aeb6-0ca41e9e7fa0 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-45f948fb-4d1a-47dc-bcf6-11069f688eed req-0064bee4-f8dc-47d4-aeb6-0ca41e9e7fa0 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] No waiting events found dispatching network-vif-unplugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-45f948fb-4d1a-47dc-bcf6-11069f688eed req-0064bee4-f8dc-47d4-aeb6-0ca41e9e7fa0 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-unplugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Successfully updated port: 4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquired lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-6cc525c5-8696-43d0-ba03-031bd6cffa2c req-bb42c09f-bc1c-462a-b00b-8820aaa1882e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received event network-changed-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-6cc525c5-8696-43d0-ba03-031bd6cffa2c req-bb42c09f-bc1c-462a-b00b-8820aaa1882e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Refreshing instance network info cache due to event network-changed-4c326aeb-0507-41eb-b3af-3800d713adf1. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6cc525c5-8696-43d0-ba03-031bd6cffa2c req-bb42c09f-bc1c-462a-b00b-8820aaa1882e service nova] Acquiring lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Instance destroyed successfully.
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'resources' on Instance uuid 5c815cf9-c1d2-496c-b4f3-190dcd19ab98 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1329016254',display_name='tempest-ServerActionsTestOtherA-server-1084493935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1329016254',id=14,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkVPN5anh2XXeiivIGiHtn+WBt+rHOSMg3zh/uez0YkfrvS0adQ5fDROJuNHEVqbieRXHJf3+6tvz110BkRBpXfWJYP78Rb9BHIjC6wlzax3PwmZN+kJ+N61Edfk/zphA==',key_name='tempest-keypair-1076303283',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:36:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-fqo3dwe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:36:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=5c815cf9-c1d2-496c-b4f3-190dcd19ab98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "address": "fa:16:3e:57:cb:70", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e151329-5d", "ovs_interfaceid": "5e151329-5da5-4b43-a1d6-80c5fd4b9818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG os_vif [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e151329-5d, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=998c52b7-16c1-4997-b339-be648b73ce92) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:31 user nova-compute[75215]: INFO os_vif [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=5e151329-5da5-4b43-a1d6-80c5fd4b9818,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e151329-5d')
Nov 11 01:39:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Deleting instance files /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98_del
Nov 11 01:39:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Deletion of /opt/stack/data/nova/instances/5c815cf9-c1d2-496c-b4f3-190dcd19ab98_del complete
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Updating instance_info_cache with network_info: [{"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:31 user nova-compute[75215]: INFO nova.compute.manager [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 11 01:39:31 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Releasing lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Instance network_info: |[{"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6cc525c5-8696-43d0-ba03-031bd6cffa2c req-bb42c09f-bc1c-462a-b00b-8820aaa1882e service nova] Acquired lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-6cc525c5-8696-43d0-ba03-031bd6cffa2c req-bb42c09f-bc1c-462a-b00b-8820aaa1882e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Refreshing network info cache for port 4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Start _get_guest_xml network_info=[{"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:39:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:39:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1010974391',display_name='tempest-ServerStableDeviceRescueTest-server-1010974391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1010974391',id=21,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfkaGKP83nAJI9Zq4cc9NL1BKWYQSZigF7D2mln0isMcZzQZHIGOUwiELFh9YX356Sy1MZmYJXDZreCsSyFU/X9LaWgNncmobl1tJLKTTZqMlzCeglJPbm2UxvBt2mpIQ==',key_name='tempest-keypair-1030521623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d112e660a694f1698f81fd725acb1e9',ramdisk_id='',reservation_id='r-0xse7ftp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-790092664',owner_user_name='tempest-ServerStableDeviceRescueTest-790092664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94388f9dde214c389d63b78879564525',uuid=323cc88a-b1b3-4a44-9674-818ba3e317f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Converting VIF {"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=4c326aeb-0507-41eb-b3af-3800d713adf1,network=Network(a84c97a3-7e80-4252-b4ff-be2a905bea92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c326aeb-05') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lazy-loading 'pci_devices' on Instance uuid 323cc88a-b1b3-4a44-9674-818ba3e317f2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:39:31 user nova-compute[75215]:   <uuid>323cc88a-b1b3-4a44-9674-818ba3e317f2</uuid>
Nov 11 01:39:31 user nova-compute[75215]:   <name>instance-00000015</name>
Nov 11 01:39:31 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:39:31 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:39:31 user nova-compute[75215]:   <metadata>
Nov 11 01:39:31 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:39:31 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:39:31 user nova-compute[75215]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1010974391</nova:name>
Nov 11 01:39:31 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:39:31</nova:creationTime>
Nov 11 01:39:31 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:39:31 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:39:31 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:39:31 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:39:31 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:39:31 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:39:31 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:39:31 user nova-compute[75215]:       <nova:owner>
Nov 11 01:39:31 user nova-compute[75215]:         <nova:user uuid="94388f9dde214c389d63b78879564525">tempest-ServerStableDeviceRescueTest-790092664-project-member</nova:user>
Nov 11 01:39:31 user nova-compute[75215]:         <nova:project uuid="2d112e660a694f1698f81fd725acb1e9">tempest-ServerStableDeviceRescueTest-790092664</nova:project>
Nov 11 01:39:31 user nova-compute[75215]:       </nova:owner>
Nov 11 01:39:31 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:39:31 user nova-compute[75215]:       <nova:ports>
Nov 11 01:39:31 user nova-compute[75215]:         <nova:port uuid="4c326aeb-0507-41eb-b3af-3800d713adf1">
Nov 11 01:39:31 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 01:39:31 user nova-compute[75215]:         </nova:port>
Nov 11 01:39:31 user nova-compute[75215]:       </nova:ports>
Nov 11 01:39:31 user nova-compute[75215]:     </nova:instance>
Nov 11 01:39:31 user nova-compute[75215]:   </metadata>
Nov 11 01:39:31 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:39:31 user nova-compute[75215]:     <system>
Nov 11 01:39:31 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:39:31 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:39:31 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:39:31 user nova-compute[75215]:       <entry name="serial">323cc88a-b1b3-4a44-9674-818ba3e317f2</entry>
Nov 11 01:39:31 user nova-compute[75215]:       <entry name="uuid">323cc88a-b1b3-4a44-9674-818ba3e317f2</entry>
Nov 11 01:39:31 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:39:31 user nova-compute[75215]:     </system>
Nov 11 01:39:31 user nova-compute[75215]:   </sysinfo>
Nov 11 01:39:31 user nova-compute[75215]:   <os>
Nov 11 01:39:31 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:39:31 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:39:31 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:39:31 user nova-compute[75215]:   </os>
Nov 11 01:39:31 user nova-compute[75215]:   <features>
Nov 11 01:39:31 user nova-compute[75215]:     <acpi/>
Nov 11 01:39:31 user nova-compute[75215]:     <apic/>
Nov 11 01:39:31 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:39:31 user nova-compute[75215]:   </features>
Nov 11 01:39:31 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:39:31 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:39:31 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:39:31 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:39:31 user nova-compute[75215]:   </clock>
Nov 11 01:39:31 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:39:31 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:39:31 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:39:31 user nova-compute[75215]:   </cpu>
Nov 11 01:39:31 user nova-compute[75215]:   <devices>
Nov 11 01:39:31 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:39:31 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:39:31 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk"/>
Nov 11 01:39:31 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:39:31 user nova-compute[75215]:     </disk>
Nov 11 01:39:31 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:39:31 user nova-compute[75215]:       <mac address="fa:16:3e:1f:6d:40"/>
Nov 11 01:39:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:39:31 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:39:31 user nova-compute[75215]:       <target dev="tap4c326aeb-05"/>
Nov 11 01:39:31 user nova-compute[75215]:     </interface>
Nov 11 01:39:31 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:39:31 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/console.log" append="off"/>
Nov 11 01:39:31 user nova-compute[75215]:     </serial>
Nov 11 01:39:31 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:39:31 user nova-compute[75215]:     <video>
Nov 11 01:39:31 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:39:31 user nova-compute[75215]:     </video>
Nov 11 01:39:31 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:39:31 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:39:31 user nova-compute[75215]:     </rng>
Nov 11 01:39:31 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:39:31 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:39:31 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:39:31 user nova-compute[75215]:     </memballoon>
Nov 11 01:39:31 user nova-compute[75215]:   </devices>
Nov 11 01:39:31 user nova-compute[75215]: </domain>
Nov 11 01:39:31 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1010974391',display_name='tempest-ServerStableDeviceRescueTest-server-1010974391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1010974391',id=21,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfkaGKP83nAJI9Zq4cc9NL1BKWYQSZigF7D2mln0isMcZzQZHIGOUwiELFh9YX356Sy1MZmYJXDZreCsSyFU/X9LaWgNncmobl1tJLKTTZqMlzCeglJPbm2UxvBt2mpIQ==',key_name='tempest-keypair-1030521623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d112e660a694f1698f81fd725acb1e9',ramdisk_id='',reservation_id='r-0xse7ftp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-790092664',owner_user_name='tempest-ServerStableDeviceRescueTest-790092664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94388f9dde214c389d63b78879564525',uuid=323cc88a-b1b3-4a44-9674-818ba3e317f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Converting VIF {"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=4c326aeb-0507-41eb-b3af-3800d713adf1,network=Network(a84c97a3-7e80-4252-b4ff-be2a905bea92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c326aeb-05') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG os_vif [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=4c326aeb-0507-41eb-b3af-3800d713adf1,network=Network(a84c97a3-7e80-4252-b4ff-be2a905bea92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c326aeb-05') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10ff05bb-2e72-5901-8101-843a81711f9e', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c326aeb-05, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c326aeb-05, col_values=(('qos', UUID('9cc0b221-f598-49eb-9fac-c7d3f38deae3')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c326aeb-05, col_values=(('external_ids', {'iface-id': '4c326aeb-0507-41eb-b3af-3800d713adf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:6d:40', 'vm-uuid': '323cc88a-b1b3-4a44-9674-818ba3e317f2'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:31 user nova-compute[75215]: INFO os_vif [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=4c326aeb-0507-41eb-b3af-3800d713adf1,network=Network(a84c97a3-7e80-4252-b4ff-be2a905bea92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c326aeb-05')
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] No VIF found with MAC fa:16:3e:1f:6d:40, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-6cc525c5-8696-43d0-ba03-031bd6cffa2c req-bb42c09f-bc1c-462a-b00b-8820aaa1882e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Updated VIF entry in instance network info cache for port 4c326aeb-0507-41eb-b3af-3800d713adf1. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG nova.network.neutron [req-6cc525c5-8696-43d0-ba03-031bd6cffa2c req-bb42c09f-bc1c-462a-b00b-8820aaa1882e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Updating instance_info_cache with network_info: [{"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6cc525c5-8696-43d0-ba03-031bd6cffa2c req-bb42c09f-bc1c-462a-b00b-8820aaa1882e service nova] Releasing lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:32 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Took 0.97 seconds to deallocate network for instance.
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:32 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Deleted allocations for instance 5c815cf9-c1d2-496c-b4f3-190dcd19ab98
Nov 11 01:39:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-1840e73a-5b1d-4a86-95b7-54570c3e9342 req-3575c721-b152-450e-98e5-13faeeb305d1 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1840e73a-5b1d-4a86-95b7-54570c3e9342 req-3575c721-b152-450e-98e5-13faeeb305d1 service nova] Acquiring lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1840e73a-5b1d-4a86-95b7-54570c3e9342 req-3575c721-b152-450e-98e5-13faeeb305d1 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1840e73a-5b1d-4a86-95b7-54570c3e9342 req-3575c721-b152-450e-98e5-13faeeb305d1 service nova] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-1840e73a-5b1d-4a86-95b7-54570c3e9342 req-3575c721-b152-450e-98e5-13faeeb305d1 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] No waiting events found dispatching network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:32 user nova-compute[75215]: WARNING nova.compute.manager [req-1840e73a-5b1d-4a86-95b7-54570c3e9342 req-3575c721-b152-450e-98e5-13faeeb305d1 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received unexpected event network-vif-plugged-5e151329-5da5-4b43-a1d6-80c5fd4b9818 for instance with vm_state deleted and task_state None.
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f01b410d-c1af-4ca3-bb12-0ef63a3f56f0 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "5c815cf9-c1d2-496c-b4f3-190dcd19ab98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-df28d355-17b8-421f-b643-46d12e214ac7 req-85930da3-0599-4235-95bf-c52c0d778461 service nova] [instance: 5c815cf9-c1d2-496c-b4f3-190dcd19ab98] Received event network-vif-deleted-5e151329-5da5-4b43-a1d6-80c5fd4b9818 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:39:33 user nova-compute[75215]: INFO nova.compute.claims [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Claim successful on node user
Nov 11 01:39:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:39:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.policy [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da821cfc028b48f6864c064b2ea97c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792836033673405bb7375a08ddc89e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:39:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Creating image(s)
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "/opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "/opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "/opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk 1073741824" returned: 0 in 0.053s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Successfully created port: f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Cannot resize image /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Ensure instance console log exists: /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Successfully updated port: f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquired lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-9498f858-c43c-4f62-aad2-2ef30ecdc958 req-c2e207fc-036a-46b8-a511-c102c2ab0f6c service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received event network-changed-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-9498f858-c43c-4f62-aad2-2ef30ecdc958 req-c2e207fc-036a-46b8-a511-c102c2ab0f6c service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Refreshing instance network info cache due to event network-changed-f60519c0-e63a-490a-82cb-60c9aef6020d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9498f858-c43c-4f62-aad2-2ef30ecdc958 req-c2e207fc-036a-46b8-a511-c102c2ab0f6c service nova] Acquiring lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:39:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Instance spawned successfully.
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:35 user nova-compute[75215]: INFO nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Updating instance_info_cache with network_info: [{"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Releasing lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Instance network_info: |[{"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9498f858-c43c-4f62-aad2-2ef30ecdc958 req-c2e207fc-036a-46b8-a511-c102c2ab0f6c service nova] Acquired lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-9498f858-c43c-4f62-aad2-2ef30ecdc958 req-c2e207fc-036a-46b8-a511-c102c2ab0f6c service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Refreshing network info cache for port f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Start _get_guest_xml network_info=[{"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:39:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:39:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-71869212',display_name='tempest-AttachVolumeNegativeTest-server-71869212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-71869212',id=22,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbdNS9WnPXP1iMjovH1ER1bS63ztHAifd6Ih9uEa8RZfAjQiY56Vl0hkXNASaOdMuB1dW7fF/In8carz+sQ3sLL35EkpSKHgYI2VLwzpZoFdJFKM0nj/hOPW5vMBSpoWw==',key_name='tempest-keypair-1496982466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-q8xhcv19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=d207b4de-98f2-41ce-ba8f-af7583b6bb76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=f60519c0-e63a-490a-82cb-60c9aef6020d,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60519c0-e6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'pci_devices' on Instance uuid d207b4de-98f2-41ce-ba8f-af7583b6bb76 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:39:35 user nova-compute[75215]: INFO nova.compute.manager [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Took 7.36 seconds to build instance.
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:39:35 user nova-compute[75215]:   <uuid>d207b4de-98f2-41ce-ba8f-af7583b6bb76</uuid>
Nov 11 01:39:35 user nova-compute[75215]:   <name>instance-00000016</name>
Nov 11 01:39:35 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:39:35 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:39:35 user nova-compute[75215]:   <metadata>
Nov 11 01:39:35 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:39:35 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:39:35 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeNegativeTest-server-71869212</nova:name>
Nov 11 01:39:35 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:39:35</nova:creationTime>
Nov 11 01:39:35 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:39:35 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:39:35 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:39:35 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:39:35 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:39:35 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:39:35 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:39:35 user nova-compute[75215]:       <nova:owner>
Nov 11 01:39:35 user nova-compute[75215]:         <nova:user uuid="da821cfc028b48f6864c064b2ea97c02">tempest-AttachVolumeNegativeTest-791087113-project-member</nova:user>
Nov 11 01:39:35 user nova-compute[75215]:         <nova:project uuid="792836033673405bb7375a08ddc89e18">tempest-AttachVolumeNegativeTest-791087113</nova:project>
Nov 11 01:39:35 user nova-compute[75215]:       </nova:owner>
Nov 11 01:39:35 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:39:35 user nova-compute[75215]:       <nova:ports>
Nov 11 01:39:35 user nova-compute[75215]:         <nova:port uuid="f60519c0-e63a-490a-82cb-60c9aef6020d">
Nov 11 01:39:35 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 01:39:35 user nova-compute[75215]:         </nova:port>
Nov 11 01:39:35 user nova-compute[75215]:       </nova:ports>
Nov 11 01:39:35 user nova-compute[75215]:     </nova:instance>
Nov 11 01:39:35 user nova-compute[75215]:   </metadata>
Nov 11 01:39:35 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:39:35 user nova-compute[75215]:     <system>
Nov 11 01:39:35 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:39:35 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:39:35 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:39:35 user nova-compute[75215]:       <entry name="serial">d207b4de-98f2-41ce-ba8f-af7583b6bb76</entry>
Nov 11 01:39:35 user nova-compute[75215]:       <entry name="uuid">d207b4de-98f2-41ce-ba8f-af7583b6bb76</entry>
Nov 11 01:39:35 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:39:35 user nova-compute[75215]:     </system>
Nov 11 01:39:35 user nova-compute[75215]:   </sysinfo>
Nov 11 01:39:35 user nova-compute[75215]:   <os>
Nov 11 01:39:35 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:39:35 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:39:35 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:39:35 user nova-compute[75215]:   </os>
Nov 11 01:39:35 user nova-compute[75215]:   <features>
Nov 11 01:39:35 user nova-compute[75215]:     <acpi/>
Nov 11 01:39:35 user nova-compute[75215]:     <apic/>
Nov 11 01:39:35 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:39:35 user nova-compute[75215]:   </features>
Nov 11 01:39:35 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:39:35 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:39:35 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:39:35 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:39:35 user nova-compute[75215]:   </clock>
Nov 11 01:39:35 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:39:35 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:39:35 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:39:35 user nova-compute[75215]:   </cpu>
Nov 11 01:39:35 user nova-compute[75215]:   <devices>
Nov 11 01:39:35 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:39:35 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:39:35 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk"/>
Nov 11 01:39:35 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:39:35 user nova-compute[75215]:     </disk>
Nov 11 01:39:35 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:39:35 user nova-compute[75215]:       <mac address="fa:16:3e:56:3e:4d"/>
Nov 11 01:39:35 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:39:35 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:39:35 user nova-compute[75215]:       <target dev="tapf60519c0-e6"/>
Nov 11 01:39:35 user nova-compute[75215]:     </interface>
Nov 11 01:39:35 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:39:35 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/console.log" append="off"/>
Nov 11 01:39:35 user nova-compute[75215]:     </serial>
Nov 11 01:39:35 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:39:35 user nova-compute[75215]:     <video>
Nov 11 01:39:35 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:39:35 user nova-compute[75215]:     </video>
Nov 11 01:39:35 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:39:35 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:39:35 user nova-compute[75215]:     </rng>
Nov 11 01:39:35 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:39:35 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:39:35 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:39:35 user nova-compute[75215]:     </memballoon>
Nov 11 01:39:35 user nova-compute[75215]:   </devices>
Nov 11 01:39:35 user nova-compute[75215]: </domain>
Nov 11 01:39:35 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-71869212',display_name='tempest-AttachVolumeNegativeTest-server-71869212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-71869212',id=22,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbdNS9WnPXP1iMjovH1ER1bS63ztHAifd6Ih9uEa8RZfAjQiY56Vl0hkXNASaOdMuB1dW7fF/In8carz+sQ3sLL35EkpSKHgYI2VLwzpZoFdJFKM0nj/hOPW5vMBSpoWw==',key_name='tempest-keypair-1496982466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-q8xhcv19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=d207b4de-98f2-41ce-ba8f-af7583b6bb76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=f60519c0-e63a-490a-82cb-60c9aef6020d,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60519c0-e6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG os_vif [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=f60519c0-e63a-490a-82cb-60c9aef6020d,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60519c0-e6') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e479f96-a653-5ed0-9a5c-71acf1e31af7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf60519c0-e6, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf60519c0-e6, col_values=(('qos', UUID('adebd9b9-7fb3-43c1-bd99-12d5a08a8a1e')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf60519c0-e6, col_values=(('external_ids', {'iface-id': 'f60519c0-e63a-490a-82cb-60c9aef6020d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:3e:4d', 'vm-uuid': 'd207b4de-98f2-41ce-ba8f-af7583b6bb76'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-10600ef4-d8cf-435a-9d0a-065337abca4d tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.521s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:35 user nova-compute[75215]: INFO os_vif [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=f60519c0-e63a-490a-82cb-60c9aef6020d,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60519c0-e6')
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No VIF found with MAC fa:16:3e:56:3e:4d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-9498f858-c43c-4f62-aad2-2ef30ecdc958 req-c2e207fc-036a-46b8-a511-c102c2ab0f6c service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Updated VIF entry in instance network info cache for port f60519c0-e63a-490a-82cb-60c9aef6020d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-9498f858-c43c-4f62-aad2-2ef30ecdc958 req-c2e207fc-036a-46b8-a511-c102c2ab0f6c service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Updating instance_info_cache with network_info: [{"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:39:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9498f858-c43c-4f62-aad2-2ef30ecdc958 req-c2e207fc-036a-46b8-a511-c102c2ab0f6c service nova] Releasing lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received event network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] No waiting events found dispatching network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:36 user nova-compute[75215]: WARNING nova.compute.manager [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received unexpected event network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 for instance with vm_state active and task_state None.
Nov 11 01:39:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received event network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] No waiting events found dispatching network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:36 user nova-compute[75215]: WARNING nova.compute.manager [req-4c9ca274-dbdd-4968-bb95-fc1fe9c57a33 req-f560d7f5-43a8-40d1-975f-76f63ad8f65e service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received unexpected event network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 for instance with vm_state active and task_state None.
Nov 11 01:39:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received event network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] No waiting events found dispatching network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:38 user nova-compute[75215]: WARNING nova.compute.manager [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received unexpected event network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d for instance with vm_state building and task_state spawning.
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received event network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] No waiting events found dispatching network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:39:38 user nova-compute[75215]: WARNING nova.compute.manager [req-1d4f8e31-cb8a-42ec-a992-2332b6532de0 req-a6467949-99cf-4179-bb6b-b8807ac78570 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received unexpected event network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d for instance with vm_state building and task_state spawning.
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:39:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Instance spawned successfully.
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:39:39 user nova-compute[75215]: INFO nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 11 01:39:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:39:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:39 user nova-compute[75215]: INFO nova.compute.manager [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Took 6.18 seconds to build instance.
Nov 11 01:39:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c0690763-513c-4d3e-9517-e1213b9a18ce tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.288s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:39:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:45 user nova-compute[75215]: INFO nova.virt.block_device [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Booting with volume c959653d-65b1-4472-84e0-a072a8a07c64 at /dev/vdc
Nov 11 01:39:45 user nova-compute[75215]: DEBUG os_brick.utils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5555bf-7ba3-4103-9cde-51580c3e92b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb3782-96e9-42c6-bb14-5a63000ddda1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[477f695b-bd09-41b8-bea9-c97d087a338b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c837752-5915-43bd-ad14-b0679528a6e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:39:46 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:39:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca3e74-c8e8-42fd-9863-3b4becb45f98]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG os_brick.utils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:39:46 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating existing volume attachment record: 2d5f1150-a1fa-4445-99be-69012c7be48f {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:39:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:39:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:39:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:39:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:40:00 user nova-compute[75215]: INFO nova.compute.claims [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Claim successful on node user
Nov 11 01:40:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:40:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.policy [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec2a1a4aed354d499952775c177f376f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351ac5c20f4fa0be12a86bd5cd5ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:40:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Creating image(s)
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "/opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "/opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "/opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk 1073741824" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.373s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Successfully created port: 8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Cannot resize image /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Ensure instance console log exists: /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Successfully updated port: 8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "refresh_cache-d48231dc-e985-40ec-a122-fa4a24618e8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquired lock "refresh_cache-d48231dc-e985-40ec-a122-fa4a24618e8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-2ef8fe6c-781c-4c19-929e-3b1ffc1b413f req-96d48711-596d-4cfe-af49-929c8db6e8b0 service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-changed-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-2ef8fe6c-781c-4c19-929e-3b1ffc1b413f req-96d48711-596d-4cfe-af49-929c8db6e8b0 service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Refreshing instance network info cache due to event network-changed-8780765c-2b58-4252-8dcf-76ad64824854. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2ef8fe6c-781c-4c19-929e-3b1ffc1b413f req-96d48711-596d-4cfe-af49-929c8db6e8b0 service nova] Acquiring lock "refresh_cache-d48231dc-e985-40ec-a122-fa4a24618e8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Updating instance_info_cache with network_info: [{"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Releasing lock "refresh_cache-d48231dc-e985-40ec-a122-fa4a24618e8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Instance network_info: |[{"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2ef8fe6c-781c-4c19-929e-3b1ffc1b413f req-96d48711-596d-4cfe-af49-929c8db6e8b0 service nova] Acquired lock "refresh_cache-d48231dc-e985-40ec-a122-fa4a24618e8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-2ef8fe6c-781c-4c19-929e-3b1ffc1b413f req-96d48711-596d-4cfe-af49-929c8db6e8b0 service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Refreshing network info cache for port 8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Start _get_guest_xml network_info=[{"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:40:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:40:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1492560123',display_name='tempest-VolumesActionsTest-instance-1492560123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1492560123',id=23,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28351ac5c20f4fa0be12a86bd5cd5ce9',ramdisk_id='',reservation_id='r-v9h0lmlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-979308973',owner_user_name='tempest-VolumesActionsTest-979308973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:40:01Z,user_data=None,user_id='ec2a1a4aed354d499952775c177f376f',uuid=d48231dc-e985-40ec-a122-fa4a24618e8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converting VIF {"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b9:71,bridge_name='br-int',has_traffic_filtering=True,id=8780765c-2b58-4252-8dcf-76ad64824854,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8780765c-2b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lazy-loading 'pci_devices' on Instance uuid d48231dc-e985-40ec-a122-fa4a24618e8d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:40:02 user nova-compute[75215]:   <uuid>d48231dc-e985-40ec-a122-fa4a24618e8d</uuid>
Nov 11 01:40:02 user nova-compute[75215]:   <name>instance-00000017</name>
Nov 11 01:40:02 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:40:02 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:40:02 user nova-compute[75215]:   <metadata>
Nov 11 01:40:02 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:40:02 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:40:02 user nova-compute[75215]:       <nova:name>tempest-VolumesActionsTest-instance-1492560123</nova:name>
Nov 11 01:40:02 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:40:02</nova:creationTime>
Nov 11 01:40:02 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:40:02 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:40:02 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:40:02 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:40:02 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:40:02 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:40:02 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:40:02 user nova-compute[75215]:       <nova:owner>
Nov 11 01:40:02 user nova-compute[75215]:         <nova:user uuid="ec2a1a4aed354d499952775c177f376f">tempest-VolumesActionsTest-979308973-project-member</nova:user>
Nov 11 01:40:02 user nova-compute[75215]:         <nova:project uuid="28351ac5c20f4fa0be12a86bd5cd5ce9">tempest-VolumesActionsTest-979308973</nova:project>
Nov 11 01:40:02 user nova-compute[75215]:       </nova:owner>
Nov 11 01:40:02 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:40:02 user nova-compute[75215]:       <nova:ports>
Nov 11 01:40:02 user nova-compute[75215]:         <nova:port uuid="8780765c-2b58-4252-8dcf-76ad64824854">
Nov 11 01:40:02 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:40:02 user nova-compute[75215]:         </nova:port>
Nov 11 01:40:02 user nova-compute[75215]:       </nova:ports>
Nov 11 01:40:02 user nova-compute[75215]:     </nova:instance>
Nov 11 01:40:02 user nova-compute[75215]:   </metadata>
Nov 11 01:40:02 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:40:02 user nova-compute[75215]:     <system>
Nov 11 01:40:02 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:40:02 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:40:02 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:40:02 user nova-compute[75215]:       <entry name="serial">d48231dc-e985-40ec-a122-fa4a24618e8d</entry>
Nov 11 01:40:02 user nova-compute[75215]:       <entry name="uuid">d48231dc-e985-40ec-a122-fa4a24618e8d</entry>
Nov 11 01:40:02 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:40:02 user nova-compute[75215]:     </system>
Nov 11 01:40:02 user nova-compute[75215]:   </sysinfo>
Nov 11 01:40:02 user nova-compute[75215]:   <os>
Nov 11 01:40:02 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:40:02 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:40:02 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:40:02 user nova-compute[75215]:   </os>
Nov 11 01:40:02 user nova-compute[75215]:   <features>
Nov 11 01:40:02 user nova-compute[75215]:     <acpi/>
Nov 11 01:40:02 user nova-compute[75215]:     <apic/>
Nov 11 01:40:02 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:40:02 user nova-compute[75215]:   </features>
Nov 11 01:40:02 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:40:02 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:40:02 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:40:02 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:40:02 user nova-compute[75215]:   </clock>
Nov 11 01:40:02 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:40:02 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:40:02 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:40:02 user nova-compute[75215]:   </cpu>
Nov 11 01:40:02 user nova-compute[75215]:   <devices>
Nov 11 01:40:02 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:40:02 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:40:02 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk"/>
Nov 11 01:40:02 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:40:02 user nova-compute[75215]:     </disk>
Nov 11 01:40:02 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:40:02 user nova-compute[75215]:       <mac address="fa:16:3e:ae:b9:71"/>
Nov 11 01:40:02 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:02 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:40:02 user nova-compute[75215]:       <target dev="tap8780765c-2b"/>
Nov 11 01:40:02 user nova-compute[75215]:     </interface>
Nov 11 01:40:02 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:40:02 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/console.log" append="off"/>
Nov 11 01:40:02 user nova-compute[75215]:     </serial>
Nov 11 01:40:02 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:40:02 user nova-compute[75215]:     <video>
Nov 11 01:40:02 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:02 user nova-compute[75215]:     </video>
Nov 11 01:40:02 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:40:02 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:40:02 user nova-compute[75215]:     </rng>
Nov 11 01:40:02 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:40:02 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:40:02 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:40:02 user nova-compute[75215]:     </memballoon>
Nov 11 01:40:02 user nova-compute[75215]:   </devices>
Nov 11 01:40:02 user nova-compute[75215]: </domain>
Nov 11 01:40:02 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1492560123',display_name='tempest-VolumesActionsTest-instance-1492560123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1492560123',id=23,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28351ac5c20f4fa0be12a86bd5cd5ce9',ramdisk_id='',reservation_id='r-v9h0lmlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-979308973',owner_user_name='tempest-VolumesActionsTest-979308973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:40:01Z,user_data=None,user_id='ec2a1a4aed354d499952775c177f376f',uuid=d48231dc-e985-40ec-a122-fa4a24618e8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converting VIF {"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b9:71,bridge_name='br-int',has_traffic_filtering=True,id=8780765c-2b58-4252-8dcf-76ad64824854,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8780765c-2b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG os_vif [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b9:71,bridge_name='br-int',has_traffic_filtering=True,id=8780765c-2b58-4252-8dcf-76ad64824854,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8780765c-2b') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '822640c9-e5f8-5294-9c8b-50e7d6807a3d', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8780765c-2b, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8780765c-2b, col_values=(('qos', UUID('8af3a276-5b0e-4eb8-ae95-8eec8120301d')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8780765c-2b, col_values=(('external_ids', {'iface-id': '8780765c-2b58-4252-8dcf-76ad64824854', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:b9:71', 'vm-uuid': 'd48231dc-e985-40ec-a122-fa4a24618e8d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:02 user nova-compute[75215]: INFO os_vif [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b9:71,bridge_name='br-int',has_traffic_filtering=True,id=8780765c-2b58-4252-8dcf-76ad64824854,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8780765c-2b')
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:40:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] No VIF found with MAC fa:16:3e:ae:b9:71, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.network.neutron [req-2ef8fe6c-781c-4c19-929e-3b1ffc1b413f req-96d48711-596d-4cfe-af49-929c8db6e8b0 service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Updated VIF entry in instance network info cache for port 8780765c-2b58-4252-8dcf-76ad64824854. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.network.neutron [req-2ef8fe6c-781c-4c19-929e-3b1ffc1b413f req-96d48711-596d-4cfe-af49-929c8db6e8b0 service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Updating instance_info_cache with network_info: [{"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2ef8fe6c-781c-4c19-929e-3b1ffc1b413f req-96d48711-596d-4cfe-af49-929c8db6e8b0 service nova] Releasing lock "refresh_cache-d48231dc-e985-40ec-a122-fa4a24618e8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:40:03 user nova-compute[75215]: INFO nova.compute.manager [None req-f04f6c14-b84d-4c0d-9227-eaf9a87eeeb8 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Get console output
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:03 user nova-compute[75215]: INFO nova.compute.manager [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Terminating instance
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] During wait destroy, instance disappeared. {{(pid=75215) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 11 01:40:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Instance destroyed successfully.
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.objects.instance [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lazy-loading 'resources' on Instance uuid ed9354d9-106b-4ca5-8f60-0140c85e74ca {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1133547420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2101150845',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI4xbc95iRypDAXtYtVCO2XHcCPICwFh7x9vwaMc7ulWk0+0mVr9rQal/5zIvQw6Njf9/8Y5wXTBvl/liRgZNXAw1KwVINNL356/u7AJIV/xrZ/d2bCck0lMCyf6SxzlQ==',key_name='tempest-keypair-112562791',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='0197414e73eb4e288859873fdfbff020',ramdisk_id='',reservation_id='r-5y9diyza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-470050517',owner_user_name='tempest-ServerActionsV293TestJSON-470050517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb61d2710ea47d587e79463829c8a3e',uuid=ed9354d9-106b-4ca5-8f60-0140c85e74ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Converting VIF {"id": "61201a0d-3ca2-4630-8fda-8296efd0325e", "address": "fa:16:3e:d5:46:b5", "network": {"id": "92b3645e-f021-45b6-a576-42b2944ae946", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-22407080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0197414e73eb4e288859873fdfbff020", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61201a0d-3c", "ovs_interfaceid": "61201a0d-3ca2-4630-8fda-8296efd0325e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_vif [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61201a0d-3c, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:03 user nova-compute[75215]: INFO os_vif [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:46:b5,bridge_name='br-int',has_traffic_filtering=True,id=61201a0d-3ca2-4630-8fda-8296efd0325e,network=Network(92b3645e-f021-45b6-a576-42b2944ae946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61201a0d-3c')
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uahLfXcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:40:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b644081c-9fd7-46bf-8750-d365059ac278]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:40:03 user nova-compute[75215]: No targets found.
Nov 11 01:40:03 user nova-compute[75215]: iSNS:
Nov 11 01:40:03 user nova-compute[75215]: No targets found.
Nov 11 01:40:03 user nova-compute[75215]: STATIC:
Nov 11 01:40:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:40:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:40:03 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:40:03 user nova-compute[75215]: FIRMWARE:
Nov 11 01:40:03 user nova-compute[75215]: No targets found.
Nov 11 01:40:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:40:03 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:40:03 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02bab4fc-3d0f-449a-b7a0-ef86c368498c', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca82704-fe14-4fbb-bd43-9a67a7e2380b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd31b3ba-18ff-44b7-af97-db85da3c3236]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404448b7f0>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] <== disconnect_volume: return (83ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:40:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Deletion of /opt/stack/data/nova/instances/ed9354d9-106b-4ca5-8f60-0140c85e74ca_del complete
Nov 11 01:40:03 user nova-compute[75215]: INFO nova.compute.manager [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Took 0.19 seconds to destroy the instance on the hypervisor.
Nov 11 01:40:03 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:40:03 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-342b62f5-fd9e-488d-81b0-90745f49aa3c req-e7cb6e53-cfde-4bff-a519-a631ba931489 service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-342b62f5-fd9e-488d-81b0-90745f49aa3c req-e7cb6e53-cfde-4bff-a519-a631ba931489 service nova] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-342b62f5-fd9e-488d-81b0-90745f49aa3c req-e7cb6e53-cfde-4bff-a519-a631ba931489 service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-342b62f5-fd9e-488d-81b0-90745f49aa3c req-e7cb6e53-cfde-4bff-a519-a631ba931489 service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-342b62f5-fd9e-488d-81b0-90745f49aa3c req-e7cb6e53-cfde-4bff-a519-a631ba931489 service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] No waiting events found dispatching network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:04 user nova-compute[75215]: WARNING nova.compute.manager [req-342b62f5-fd9e-488d-81b0-90745f49aa3c req-e7cb6e53-cfde-4bff-a519-a631ba931489 service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received unexpected event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 for instance with vm_state building and task_state spawning.
Nov 11 01:40:04 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:40:04 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Took 0.89 seconds to deallocate network for instance.
Nov 11 01:40:04 user nova-compute[75215]: INFO nova.compute.manager [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Took 0.10 seconds to detach 1 volumes for instance.
Nov 11 01:40:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Deleting volume: 02bab4fc-3d0f-449a-b7a0-ef86c368498c {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:05 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:40:05 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:40:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:05 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Deleted allocations for instance ed9354d9-106b-4ca5-8f60-0140c85e74ca
Nov 11 01:40:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb94f50f-36ad-4665-8d26-948edb3e0556 tempest-ServerActionsV293TestJSON-470050517 tempest-ServerActionsV293TestJSON-470050517-project-member] Lock "ed9354d9-106b-4ca5-8f60-0140c85e74ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-b6ca038b-25e0-4f6e-aad9-b59750ca6dad req-55cc60a5-e280-4100-a1cf-f528699055fe service nova] [instance: ed9354d9-106b-4ca5-8f60-0140c85e74ca] Received event network-vif-deleted-61201a0d-3ca2-4630-8fda-8296efd0325e {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-b6ca038b-25e0-4f6e-aad9-b59750ca6dad req-55cc60a5-e280-4100-a1cf-f528699055fe service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b6ca038b-25e0-4f6e-aad9-b59750ca6dad req-55cc60a5-e280-4100-a1cf-f528699055fe service nova] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b6ca038b-25e0-4f6e-aad9-b59750ca6dad req-55cc60a5-e280-4100-a1cf-f528699055fe service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b6ca038b-25e0-4f6e-aad9-b59750ca6dad req-55cc60a5-e280-4100-a1cf-f528699055fe service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-b6ca038b-25e0-4f6e-aad9-b59750ca6dad req-55cc60a5-e280-4100-a1cf-f528699055fe service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] No waiting events found dispatching network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:06 user nova-compute[75215]: WARNING nova.compute.manager [req-b6ca038b-25e0-4f6e-aad9-b59750ca6dad req-55cc60a5-e280-4100-a1cf-f528699055fe service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received unexpected event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 for instance with vm_state building and task_state spawning.
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:40:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Instance spawned successfully.
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:06 user nova-compute[75215]: INFO nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 11 01:40:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:40:07 user nova-compute[75215]: INFO nova.compute.manager [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Took 7.05 seconds to build instance.
Nov 11 01:40:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4fdcde2a-b5af-4d84-884f-60106e63b158 tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.152s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:14 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:40:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:15 user nova-compute[75215]: INFO nova.compute.manager [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Unshelving
Nov 11 01:40:15 user nova-compute[75215]: INFO nova.virt.block_device [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Booting with volume be297bd8-4300-4833-a3a0-dbe6e12ab4ad at /dev/vdc
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG os_brick.utils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2d1628-2859-4951-b49c-fc1a0d85fcbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28f8889-63a1-4990-9a51-d43067cca3e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c42d698-e441-47e3-a944-7ab3893b6fda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a9a393-2896-464c-80f4-f927c85e913b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:40:16 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[35418ab5-024c-4a04-bfc9-370f7780bcb6]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG os_brick.utils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating existing volume attachment record: 36652f41-a61d-46ca-9ced-57e68928a2bd {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:40:17 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:40:17 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7772MB free_disk=25.391258239746094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:40:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance e6560dd5-4f17-417d-bb0c-269e0284207d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 323cc88a-b1b3-4a44-9674-818ba3e317f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d48231dc-e985-40ec-a122-fa4a24618e8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 01:40:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 01:40:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:40:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:40:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:40:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:40:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updating instance_info_cache with network_info: [{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:40:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:40:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:40:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:40:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:24 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:40:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 01:40:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:40:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Creating image(s)
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Ensure instance console log exists: /opt/stack/data/nova/instances/e6560dd5-4f17-417d-bb0c-269e0284207d/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Start _get_guest_xml network_info=[{"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '9faff6b0-5878-426a-98fa-8e04ab3fcdd4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXmWTjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6560dd5-4f17-417d-bb0c-269e0284207d', 'attached_at': '', 'detached_at': '', 'volume_id': '163ae624-3d5a-43ba-af71-dd8c20b00de4', 'serial': '163ae624-3d5a-43ba-af71-dd8c20b00de4'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '4e1eb48c-15b3-4eec-aa2b-f62bed347be7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMxqFSBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6560dd5-4f17-417d-bb0c-269e0284207d', 'attached_at': '', 'detached_at': '', 'volume_id': '9070f744-84b7-47eb-a525-c7b150fa166e', 'serial': '9070f744-84b7-47eb-a525-c7b150fa166e'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '2d5f1150-a1fa-4445-99be-69012c7be48f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQxdkMwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6560dd5-4f17-417d-bb0c-269e0284207d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c959653d-65b1-4472-84e0-a072a8a07c64', 'serial': 'c959653d-65b1-4472-84e0-a072a8a07c64'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:40:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:40:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXmWTjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:40:35 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:40:35 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:40:35 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f22856-5a3f-467a-924e-bf5c720028af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:40:35 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0332cbb-952f-40e6-9d0a-76f6ae76bc9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4] added
Nov 11 01:40:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb799057-540c-4027-bc22-6c39a64a3cd7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cc8532-3c3a-48f4-a713-0f182208438e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcXmWTjR {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcXmWTjR" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[08650d94-79dc-4f1b-8ce8-bccc27a3adfe]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcXmWTjR'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0ca8af-6748-48d7-aa00-c6978ec65b2c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67a0da-6a5c-4f46-8799-0dde7edd7d0f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7655944c-1ff1-4b2c-b9e8-9590d4f27815]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4, portal: 172.16.0.220,3260]
Nov 11 01:40:35 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4, portal: 172.16.0.220,3260] successful.
Nov 11 01:40:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b5a3de-7218-4d23-ab10-34bbf9b7e3d1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d5db87-fcf4-4808-ac1a-9901c18ac28f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:35 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:35 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:35 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e0879a-5963-47d2-b8f2-00a63589dbc3]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:40:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXmWTjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26634393565303266', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393565303266', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMxqFSBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:40:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:40:36 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:40:36 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[273688a2-2c32-4f8e-8d72-0f969b250357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:40:36 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7e52da-bdc7-4d45-b905-bbcbd8c24136]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e] added
Nov 11 01:40:36 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc76423-e365-4960-8187-bc5b782366b4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f44aa5-ea8d-43b7-b707-6566d2938aee]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMxqFSBh {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMxqFSBh" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d2ec8d-6a15-4bcb-8464-f1c2be4e8324]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMxqFSBh'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c85c43-acd9-4ee7-939f-46feb193c1e9]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[764e5654-9040-44d7-9699-4f96f0287a62]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:37 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:37 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad09038-6f90-417c-b0cf-f3dc49372fed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e, portal: 172.16.0.220,3260]
Nov 11 01:40:37 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e, portal: 172.16.0.220,3260] successful.
Nov 11 01:40:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc1e171-8a60-4532-8ade-76b7528ca881]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdfc844-67ac-433c-b145-5cd2832163da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:37 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:37 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:40:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:37 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:37 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:40:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[373d8270-be07-44d0-b07c-ede289d4bb52]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMxqFSBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:40:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23432313132326333', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432313132326333', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQxdkMwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:40:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:40:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:40:38 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1587745e-923a-48e1-ba46-60519ee4dade]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:40:38 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fa174c-7670-4bb7-9680-14950eaa4a2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64] added
Nov 11 01:40:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d06b6-f3f1-462d-a7cb-d0de52e0b59b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cc1eef-8cc8-423d-a1c2-bc68c86ad52b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TQxdkMwH {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TQxdkMwH" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e978cb-04d0-49c0-a269-6ff871106bca]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TQxdkMwH'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f2b59a-396b-472f-b140-1b23aee8947e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[975fcfef-8e7f-4eb6-b51e-be6268a2d19f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:40:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:40:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df38816-7d95-489b-b9a0-058a96fff396]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64, portal: 172.16.0.220,3260]
Nov 11 01:40:38 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64, portal: 172.16.0.220,3260] successful.
Nov 11 01:40:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebc55ee-eca8-4178-b92d-a622e9d6d473]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c9d1ba-c59c-4eb9-bd6f-2556777d3709]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:40:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:40:38 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:40:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1177c30-5ac1-4d1b-b4c7-1726fdf43aee]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:40:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQxdkMwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23134373361633236', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373361633236', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:38:28,bridge_name='br-int',has_traffic_filtering=True,id=a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8,network=Network(e68cc7c3-8919-40ce-9094-eb1335a399ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c38c23-70') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c1:d1,bridge_name='br-int',has_traffic_filtering=True,id=0fa80abb-2866-47dd-b1cb-4189d05d05c1,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0fa80abb-28') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=e4bac6a4-a934-4780-9e9e-d17626b43ba9,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4bac6a4-a9') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:70:28,bridge_name='br-int',has_traffic_filtering=True,id=c9cd4ac9-bf2f-4ab5-b656-2b886152f79d,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9cd4ac9-bf') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=2166c0c2-1f64-4b1f-a947-6e269e5d682a,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166c0c2-1f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=83e59e94-7503-4236-b69f-c1b289c3f4a0,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e59e94-75') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:45,bridge_name='br-int',has_traffic_filtering=True,id=58ba476f-668b-445a-b5f0-98e63a1d665f,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ba476f-66') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lazy-loading 'pci_devices' on Instance uuid e6560dd5-4f17-417d-bb0c-269e0284207d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:40:39 user nova-compute[75215]:   <uuid>e6560dd5-4f17-417d-bb0c-269e0284207d</uuid>
Nov 11 01:40:39 user nova-compute[75215]:   <name>instance-00000013</name>
Nov 11 01:40:39 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:40:39 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:40:39 user nova-compute[75215]:   <metadata>
Nov 11 01:40:39 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:40:39 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:40:39 user nova-compute[75215]:       <nova:name>tempest-device-tagging-server-1633668785</nova:name>
Nov 11 01:40:39 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:40:35</nova:creationTime>
Nov 11 01:40:39 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:40:39 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:40:39 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:40:39 user nova-compute[75215]:       <nova:owner>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:user uuid="931b9fe1dbdb4a9ebf7419627df1e6d0">tempest-TaggedBootDevicesTest_v242-811690612-project-member</nova:user>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:project uuid="ebc975a9ec00422abc485cd279c4aa57">tempest-TaggedBootDevicesTest_v242-811690612</nova:project>
Nov 11 01:40:39 user nova-compute[75215]:       </nova:owner>
Nov 11 01:40:39 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:40:39 user nova-compute[75215]:       <nova:ports>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:port uuid="a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8">
Nov 11 01:40:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 01:40:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:port uuid="0fa80abb-2866-47dd-b1cb-4189d05d05c1">
Nov 11 01:40:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Nov 11 01:40:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:port uuid="e4bac6a4-a934-4780-9e9e-d17626b43ba9">
Nov 11 01:40:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Nov 11 01:40:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:port uuid="c9cd4ac9-bf2f-4ab5-b656-2b886152f79d">
Nov 11 01:40:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Nov 11 01:40:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:port uuid="2166c0c2-1f64-4b1f-a947-6e269e5d682a">
Nov 11 01:40:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 11 01:40:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:port uuid="83e59e94-7503-4236-b69f-c1b289c3f4a0">
Nov 11 01:40:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 11 01:40:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:40:39 user nova-compute[75215]:         <nova:port uuid="58ba476f-668b-445a-b5f0-98e63a1d665f">
Nov 11 01:40:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 11 01:40:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:40:39 user nova-compute[75215]:       </nova:ports>
Nov 11 01:40:39 user nova-compute[75215]:     </nova:instance>
Nov 11 01:40:39 user nova-compute[75215]:   </metadata>
Nov 11 01:40:39 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:40:39 user nova-compute[75215]:     <system>
Nov 11 01:40:39 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:40:39 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:40:39 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:40:39 user nova-compute[75215]:       <entry name="serial">e6560dd5-4f17-417d-bb0c-269e0284207d</entry>
Nov 11 01:40:39 user nova-compute[75215]:       <entry name="uuid">e6560dd5-4f17-417d-bb0c-269e0284207d</entry>
Nov 11 01:40:39 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:40:39 user nova-compute[75215]:     </system>
Nov 11 01:40:39 user nova-compute[75215]:   </sysinfo>
Nov 11 01:40:39 user nova-compute[75215]:   <os>
Nov 11 01:40:39 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:40:39 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:40:39 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:40:39 user nova-compute[75215]:   </os>
Nov 11 01:40:39 user nova-compute[75215]:   <features>
Nov 11 01:40:39 user nova-compute[75215]:     <acpi/>
Nov 11 01:40:39 user nova-compute[75215]:     <apic/>
Nov 11 01:40:39 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:40:39 user nova-compute[75215]:   </features>
Nov 11 01:40:39 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:40:39 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:40:39 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:40:39 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:40:39 user nova-compute[75215]:   </clock>
Nov 11 01:40:39 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:40:39 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:40:39 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:40:39 user nova-compute[75215]:   </cpu>
Nov 11 01:40:39 user nova-compute[75215]:   <devices>
Nov 11 01:40:39 user nova-compute[75215]:     <disk type="file" device="cdrom">
Nov 11 01:40:39 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none"/>
Nov 11 01:40:39 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/e6560dd5-4f17-417d-bb0c-269e0284207d/disk.config"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="hda" bus="ide"/>
Nov 11 01:40:39 user nova-compute[75215]:     </disk>
Nov 11 01:40:39 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:40:39 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:40:39 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <serial>163ae624-3d5a-43ba-af71-dd8c20b00de4</serial>
Nov 11 01:40:39 user nova-compute[75215]:     </disk>
Nov 11 01:40:39 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:40:39 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:40:39 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <serial>9070f744-84b7-47eb-a525-c7b150fa166e</serial>
Nov 11 01:40:39 user nova-compute[75215]:     </disk>
Nov 11 01:40:39 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:40:39 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:40:39 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="vdc" bus="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <serial>c959653d-65b1-4472-84e0-a072a8a07c64</serial>
Nov 11 01:40:39 user nova-compute[75215]:     </disk>
Nov 11 01:40:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:40:39 user nova-compute[75215]:       <mac address="fa:16:3e:69:38:28"/>
Nov 11 01:40:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="tapa6c38c23-70"/>
Nov 11 01:40:39 user nova-compute[75215]:     </interface>
Nov 11 01:40:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:40:39 user nova-compute[75215]:       <mac address="fa:16:3e:bd:c1:d1"/>
Nov 11 01:40:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="tap0fa80abb-28"/>
Nov 11 01:40:39 user nova-compute[75215]:     </interface>
Nov 11 01:40:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:40:39 user nova-compute[75215]:       <mac address="fa:16:3e:18:21:3b"/>
Nov 11 01:40:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="tape4bac6a4-a9"/>
Nov 11 01:40:39 user nova-compute[75215]:     </interface>
Nov 11 01:40:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:40:39 user nova-compute[75215]:       <mac address="fa:16:3e:b4:70:28"/>
Nov 11 01:40:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="tapc9cd4ac9-bf"/>
Nov 11 01:40:39 user nova-compute[75215]:     </interface>
Nov 11 01:40:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:40:39 user nova-compute[75215]:       <mac address="fa:16:3e:75:a2:86"/>
Nov 11 01:40:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="tap2166c0c2-1f"/>
Nov 11 01:40:39 user nova-compute[75215]:     </interface>
Nov 11 01:40:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:40:39 user nova-compute[75215]:       <mac address="fa:16:3e:7d:da:dc"/>
Nov 11 01:40:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="tap83e59e94-75"/>
Nov 11 01:40:39 user nova-compute[75215]:     </interface>
Nov 11 01:40:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:40:39 user nova-compute[75215]:       <mac address="fa:16:3e:3d:19:45"/>
Nov 11 01:40:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:40:39 user nova-compute[75215]:       <target dev="tap58ba476f-66"/>
Nov 11 01:40:39 user nova-compute[75215]:     </interface>
Nov 11 01:40:39 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:40:39 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/e6560dd5-4f17-417d-bb0c-269e0284207d/console.log" append="off"/>
Nov 11 01:40:39 user nova-compute[75215]:     </serial>
Nov 11 01:40:39 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:40:39 user nova-compute[75215]:     <video>
Nov 11 01:40:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:40:39 user nova-compute[75215]:     </video>
Nov 11 01:40:39 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:40:39 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:40:39 user nova-compute[75215]:     </rng>
Nov 11 01:40:39 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:40:39 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:40:39 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:40:39 user nova-compute[75215]:     </memballoon>
Nov 11 01:40:39 user nova-compute[75215]:   </devices>
Nov 11 01:40:39 user nova-compute[75215]: </domain>
Nov 11 01:40:39 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:38:28,bridge_name='br-int',has_traffic_filtering=True,id=a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8,network=Network(e68cc7c3-8919-40ce-9094-eb1335a399ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c38c23-70') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:38:28,bridge_name='br-int',has_traffic_filtering=True,id=a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8,network=Network(e68cc7c3-8919-40ce-9094-eb1335a399ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c38c23-70') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '299ee12f-55e1-51f4-967d-3e9754d70b7e', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6c38c23-70, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6c38c23-70, col_values=(('qos', UUID('a2416f88-279a-48a1-8073-81668bd1b8d7')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6c38c23-70, col_values=(('external_ids', {'iface-id': 'a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:38:28', 'vm-uuid': 'e6560dd5-4f17-417d-bb0c-269e0284207d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: INFO os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:38:28,bridge_name='br-int',has_traffic_filtering=True,id=a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8,network=Network(e68cc7c3-8919-40ce-9094-eb1335a399ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c38c23-70')
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c1:d1,bridge_name='br-int',has_traffic_filtering=True,id=0fa80abb-2866-47dd-b1cb-4189d05d05c1,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0fa80abb-28') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c1:d1,bridge_name='br-int',has_traffic_filtering=True,id=0fa80abb-2866-47dd-b1cb-4189d05d05c1,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0fa80abb-28') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97440ef4-3f1f-5bf3-9b2f-3d613f3bae01', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fa80abb-28, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fa80abb-28, col_values=(('qos', UUID('e141b3cb-42b2-4c78-98ad-cc293d75bd58')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fa80abb-28, col_values=(('external_ids', {'iface-id': '0fa80abb-2866-47dd-b1cb-4189d05d05c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:c1:d1', 'vm-uuid': 'e6560dd5-4f17-417d-bb0c-269e0284207d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: INFO os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c1:d1,bridge_name='br-int',has_traffic_filtering=True,id=0fa80abb-2866-47dd-b1cb-4189d05d05c1,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0fa80abb-28')
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=e4bac6a4-a934-4780-9e9e-d17626b43ba9,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4bac6a4-a9') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=e4bac6a4-a934-4780-9e9e-d17626b43ba9,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4bac6a4-a9') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42924d36-3da7-5cd2-b13d-ff924aec51f9', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4bac6a4-a9, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4bac6a4-a9, col_values=(('qos', UUID('59050b82-c7fd-4cb5-9cfd-f23e1f8f9ea5')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4bac6a4-a9, col_values=(('external_ids', {'iface-id': 'e4bac6a4-a934-4780-9e9e-d17626b43ba9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:21:3b', 'vm-uuid': 'e6560dd5-4f17-417d-bb0c-269e0284207d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: INFO os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=e4bac6a4-a934-4780-9e9e-d17626b43ba9,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4bac6a4-a9')
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:70:28,bridge_name='br-int',has_traffic_filtering=True,id=c9cd4ac9-bf2f-4ab5-b656-2b886152f79d,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9cd4ac9-bf') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:70:28,bridge_name='br-int',has_traffic_filtering=True,id=c9cd4ac9-bf2f-4ab5-b656-2b886152f79d,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9cd4ac9-bf') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faff8436-9a56-5cd6-afeb-559af4641f5f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9cd4ac9-bf, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9cd4ac9-bf, col_values=(('qos', UUID('74ac2feb-0cf4-4052-9244-1da748626d31')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9cd4ac9-bf, col_values=(('external_ids', {'iface-id': 'c9cd4ac9-bf2f-4ab5-b656-2b886152f79d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:70:28', 'vm-uuid': 'e6560dd5-4f17-417d-bb0c-269e0284207d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: INFO os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:70:28,bridge_name='br-int',has_traffic_filtering=True,id=c9cd4ac9-bf2f-4ab5-b656-2b886152f79d,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9cd4ac9-bf')
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=2166c0c2-1f64-4b1f-a947-6e269e5d682a,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166c0c2-1f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=2166c0c2-1f64-4b1f-a947-6e269e5d682a,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166c0c2-1f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30ae21d2-5e5e-57d1-88e6-328c975eebd0', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2166c0c2-1f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2166c0c2-1f, col_values=(('qos', UUID('2f60e641-f1da-4dab-b7ef-29cf730773c2')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2166c0c2-1f, col_values=(('external_ids', {'iface-id': '2166c0c2-1f64-4b1f-a947-6e269e5d682a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a2:86', 'vm-uuid': 'e6560dd5-4f17-417d-bb0c-269e0284207d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: INFO os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=2166c0c2-1f64-4b1f-a947-6e269e5d682a,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166c0c2-1f')
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=83e59e94-7503-4236-b69f-c1b289c3f4a0,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e59e94-75') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=83e59e94-7503-4236-b69f-c1b289c3f4a0,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e59e94-75') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c47c4082-5290-5825-bab7-8c9b97cd2366', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83e59e94-75, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83e59e94-75, col_values=(('qos', UUID('f85bb599-20b4-4114-af4c-9a1c97410a43')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83e59e94-75, col_values=(('external_ids', {'iface-id': '83e59e94-7503-4236-b69f-c1b289c3f4a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:da:dc', 'vm-uuid': 'e6560dd5-4f17-417d-bb0c-269e0284207d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: INFO os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=83e59e94-7503-4236-b69f-c1b289c3f4a0,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e59e94-75')
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:45,bridge_name='br-int',has_traffic_filtering=True,id=58ba476f-668b-445a-b5f0-98e63a1d665f,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ba476f-66') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:45,bridge_name='br-int',has_traffic_filtering=True,id=58ba476f-668b-445a-b5f0-98e63a1d665f,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ba476f-66') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'affc6035-ac7d-5f41-bffe-b490d4c907ac', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58ba476f-66, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58ba476f-66, col_values=(('qos', UUID('98393173-c4bc-45dd-b93f-be0f3531b81c')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58ba476f-66, col_values=(('external_ids', {'iface-id': '58ba476f-668b-445a-b5f0-98e63a1d665f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:19:45', 'vm-uuid': 'e6560dd5-4f17-417d-bb0c-269e0284207d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:40 user nova-compute[75215]: INFO os_vif [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:45,bridge_name='br-int',has_traffic_filtering=True,id=58ba476f-668b-445a-b5f0-98e63a1d665f,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ba476f-66')
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] No BDM found with device name hda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] No VIF found with MAC fa:16:3e:69:38:28, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] No VIF found with MAC fa:16:3e:75:a2:86, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:40:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Using config drive
Nov 11 01:40:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Creating config drive at /opt/stack/data/nova/instances/e6560dd5-4f17-417d-bb0c-269e0284207d/disk.config
Nov 11 01:40:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e6560dd5-4f17-417d-bb0c-269e0284207d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsnquen42 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e6560dd5-4f17-417d-bb0c-269e0284207d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsnquen42" returned: 0 in 0.063s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:40:40 user nova-compute[75215]: INFO nova.compute.manager [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] instance snapshotting
Nov 11 01:40:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Beginning live snapshot process
Nov 11 01:40:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp72e2_2e_/8e8bb71b58cb4ae29e0863ef69f50550.delta 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp72e2_2e_/8e8bb71b58cb4ae29e0863ef69f50550.delta 1073741824" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 11 01:40:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-9a6bc399-404a-49a1-b9e0-ba8d50f3320d req-eafdb232-9583-43f3-9762-f32f66ad8e89 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9a6bc399-404a-49a1-b9e0-ba8d50f3320d req-eafdb232-9583-43f3-9762-f32f66ad8e89 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9a6bc399-404a-49a1-b9e0-ba8d50f3320d req-eafdb232-9583-43f3-9762-f32f66ad8e89 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9a6bc399-404a-49a1-b9e0-ba8d50f3320d req-eafdb232-9583-43f3-9762-f32f66ad8e89 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-9a6bc399-404a-49a1-b9e0-ba8d50f3320d req-eafdb232-9583-43f3-9762-f32f66ad8e89 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:42 user nova-compute[75215]: WARNING nova.compute.manager [req-9a6bc399-404a-49a1-b9e0-ba8d50f3320d req-eafdb232-9583-43f3-9762-f32f66ad8e89 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 for instance with vm_state building and task_state spawning.
Nov 11 01:40:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 01:40:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 01:40:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp72e2_2e_/8e8bb71b58cb4ae29e0863ef69f50550.delta /opt/stack/data/nova/instances/snapshots/tmp72e2_2e_/8e8bb71b58cb4ae29e0863ef69f50550 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-1cc91f15-2ae5-4d73-9ce9-db9e5e8f758d req-9f685f60-2634-4714-a133-32d22ab73d76 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1cc91f15-2ae5-4d73-9ce9-db9e5e8f758d req-9f685f60-2634-4714-a133-32d22ab73d76 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1cc91f15-2ae5-4d73-9ce9-db9e5e8f758d req-9f685f60-2634-4714-a133-32d22ab73d76 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1cc91f15-2ae5-4d73-9ce9-db9e5e8f758d req-9f685f60-2634-4714-a133-32d22ab73d76 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-1cc91f15-2ae5-4d73-9ce9-db9e5e8f758d req-9f685f60-2634-4714-a133-32d22ab73d76 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:43 user nova-compute[75215]: WARNING nova.compute.manager [req-1cc91f15-2ae5-4d73-9ce9-db9e5e8f758d req-9f685f60-2634-4714-a133-32d22ab73d76 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 for instance with vm_state building and task_state spawning.
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp72e2_2e_/8e8bb71b58cb4ae29e0863ef69f50550.delta /opt/stack/data/nova/instances/snapshots/tmp72e2_2e_/8e8bb71b58cb4ae29e0863ef69f50550" returned: 0 in 0.513s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:40:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Snapshot extracted, beginning image upload
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:44 user nova-compute[75215]: WARNING nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 for instance with vm_state building and task_state spawning.
Nov 11 01:40:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:44 user nova-compute[75215]: WARNING nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d for instance with vm_state building and task_state spawning.
Nov 11 01:40:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:44 user nova-compute[75215]: WARNING nova.compute.manager [req-5a601196-aac2-434f-8aea-5772d6df32d0 req-6d2e4d4d-305d-4b70-900b-db3c8cff0484 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d for instance with vm_state building and task_state spawning.
Nov 11 01:40:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-4ebe5a1f-828e-4bf6-b6dd-75942e704cb2 req-2c50ca41-eef5-46fe-a1f2-7c0b85f72633 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4ebe5a1f-828e-4bf6-b6dd-75942e704cb2 req-2c50ca41-eef5-46fe-a1f2-7c0b85f72633 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4ebe5a1f-828e-4bf6-b6dd-75942e704cb2 req-2c50ca41-eef5-46fe-a1f2-7c0b85f72633 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4ebe5a1f-828e-4bf6-b6dd-75942e704cb2 req-2c50ca41-eef5-46fe-a1f2-7c0b85f72633 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-4ebe5a1f-828e-4bf6-b6dd-75942e704cb2 req-2c50ca41-eef5-46fe-a1f2-7c0b85f72633 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:44 user nova-compute[75215]: WARNING nova.compute.manager [req-4ebe5a1f-828e-4bf6-b6dd-75942e704cb2 req-2c50ca41-eef5-46fe-a1f2-7c0b85f72633 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a for instance with vm_state building and task_state spawning.
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:45 user nova-compute[75215]: WARNING nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 for instance with vm_state building and task_state spawning.
Nov 11 01:40:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:45 user nova-compute[75215]: WARNING nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 for instance with vm_state building and task_state spawning.
Nov 11 01:40:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:45 user nova-compute[75215]: WARNING nova.compute.manager [req-0be370a9-66fc-46b1-aebb-cdc7815d8372 req-d87c8d44-294a-4c3f-9915-4399e0fbc300 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 for instance with vm_state building and task_state spawning.
Nov 11 01:40:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:46 user nova-compute[75215]: WARNING nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 for instance with vm_state building and task_state spawning.
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:46 user nova-compute[75215]: WARNING nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 for instance with vm_state building and task_state spawning.
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:46 user nova-compute[75215]: WARNING nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f for instance with vm_state building and task_state spawning.
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:46 user nova-compute[75215]: WARNING nova.compute.manager [req-4b889393-5431-4fbe-a9bb-8bdfea711b93 req-bc926b82-16e4-4675-8e7e-ccdb43d2dfc9 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f for instance with vm_state building and task_state spawning.
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-e1c211f5-a93e-4d0b-ab9e-2242d80d0c2c req-2e093665-e033-4e94-95c2-58cf6a4b3d47 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1c211f5-a93e-4d0b-ab9e-2242d80d0c2c req-2e093665-e033-4e94-95c2-58cf6a4b3d47 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1c211f5-a93e-4d0b-ab9e-2242d80d0c2c req-2e093665-e033-4e94-95c2-58cf6a4b3d47 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1c211f5-a93e-4d0b-ab9e-2242d80d0c2c req-2e093665-e033-4e94-95c2-58cf6a4b3d47 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-e1c211f5-a93e-4d0b-ab9e-2242d80d0c2c req-2e093665-e033-4e94-95c2-58cf6a4b3d47 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:46 user nova-compute[75215]: WARNING nova.compute.manager [req-e1c211f5-a93e-4d0b-ab9e-2242d80d0c2c req-2e093665-e033-4e94-95c2-58cf6a4b3d47 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a for instance with vm_state building and task_state spawning.
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:40:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance spawned successfully.
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:40:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Snapshot image upload complete
Nov 11 01:40:47 user nova-compute[75215]: INFO nova.compute.manager [None req-2b108131-0b7c-49df-a933-bcb64503d7e8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Took 6.76 seconds to snapshot the instance on the hypervisor.
Nov 11 01:40:47 user nova-compute[75215]: INFO nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Took 12.21 seconds to spawn the instance on the hypervisor.
Nov 11 01:40:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:40:47 user nova-compute[75215]: INFO nova.compute.manager [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Took 136.55 seconds to build instance.
Nov 11 01:40:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a22b0a35-1686-456e-953b-4fd27066cc7f tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 136.658s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:40:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:40:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:40:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:58 user nova-compute[75215]: INFO nova.compute.manager [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Terminating instance
Nov 11 01:40:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-51c9fc5f-99ba-4c1f-8b58-17422aa3073f req-8d8badd5-8f01-4a63-a39d-80e2dec89707 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-51c9fc5f-99ba-4c1f-8b58-17422aa3073f req-8d8badd5-8f01-4a63-a39d-80e2dec89707 service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-51c9fc5f-99ba-4c1f-8b58-17422aa3073f req-8d8badd5-8f01-4a63-a39d-80e2dec89707 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-51c9fc5f-99ba-4c1f-8b58-17422aa3073f req-8d8badd5-8f01-4a63-a39d-80e2dec89707 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-51c9fc5f-99ba-4c1f-8b58-17422aa3073f req-8d8badd5-8f01-4a63-a39d-80e2dec89707 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-51c9fc5f-99ba-4c1f-8b58-17422aa3073f req-8d8badd5-8f01-4a63-a39d-80e2dec89707 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-unplugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Instance destroyed successfully.
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'resources' on Instance uuid 29f5d275-78e7-4292-98c8-d12f47f28fbf {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1742806291',display_name='tempest-AttachVolumeTestJSON-server-1742806291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1742806291',id=4,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUKBRZoeG0kjbjfab4oiYIh69vwpqArksDZXOnd9cvjqNmq6VmP7267qKGs++UWucvRsVK2ydENj+wL97rg0TlshKWR2JVYYYMauqdHVJ4kgjVZRcj7ALgd+UepOCFZkA==',key_name='tempest-keypair-1876284018',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-8lz7nlrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=29f5d275-78e7-4292-98c8-d12f47f28fbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "address": "fa:16:3e:7e:c3:e5", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd51c5f-2f", "ovs_interfaceid": "9fd51c5f-2f3b-4df5-92c8-3d84fe37691b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG os_vif [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fd51c5f-2f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=111bece6-96fa-45a6-bd65-fc894853fe72) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:40:59 user nova-compute[75215]: INFO os_vif [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd51c5f-2f')
Nov 11 01:40:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Deleting instance files /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf_del
Nov 11 01:40:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Deletion of /opt/stack/data/nova/instances/29f5d275-78e7-4292-98c8-d12f47f28fbf_del complete
Nov 11 01:40:59 user nova-compute[75215]: INFO nova.compute.manager [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 11 01:40:59 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:40:59 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:41:00 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:00 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Took 1.04 seconds to deallocate network for instance.
Nov 11 01:41:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-daf9d89b-c6cc-49fb-9983-1bb68b67d9ab req-e892286b-6e24-4a0f-a7e3-8ee22f23c33e service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-deleted-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:00 user nova-compute[75215]: INFO nova.compute.manager [req-daf9d89b-c6cc-49fb-9983-1bb68b67d9ab req-e892286b-6e24-4a0f-a7e3-8ee22f23c33e service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Neutron deleted interface 9fd51c5f-2f3b-4df5-92c8-3d84fe37691b; detaching it from the instance and deleting it from the info cache
Nov 11 01:41:00 user nova-compute[75215]: DEBUG nova.network.neutron [req-daf9d89b-c6cc-49fb-9983-1bb68b67d9ab req-e892286b-6e24-4a0f-a7e3-8ee22f23c33e service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-daf9d89b-c6cc-49fb-9983-1bb68b67d9ab req-e892286b-6e24-4a0f-a7e3-8ee22f23c33e service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Detach interface failed, port_id=9fd51c5f-2f3b-4df5-92c8-3d84fe37691b, reason: Instance 29f5d275-78e7-4292-98c8-d12f47f28fbf could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:41:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f8d29ed-cfce-4af3-a0be-25c06a9cecfe req-b4600d8c-e680-4ffd-a79f-6145f5108c18 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f8d29ed-cfce-4af3-a0be-25c06a9cecfe req-b4600d8c-e680-4ffd-a79f-6145f5108c18 service nova] Acquiring lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f8d29ed-cfce-4af3-a0be-25c06a9cecfe req-b4600d8c-e680-4ffd-a79f-6145f5108c18 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6f8d29ed-cfce-4af3-a0be-25c06a9cecfe req-b4600d8c-e680-4ffd-a79f-6145f5108c18 service nova] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-6f8d29ed-cfce-4af3-a0be-25c06a9cecfe req-b4600d8c-e680-4ffd-a79f-6145f5108c18 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] No waiting events found dispatching network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:01 user nova-compute[75215]: WARNING nova.compute.manager [req-6f8d29ed-cfce-4af3-a0be-25c06a9cecfe req-b4600d8c-e680-4ffd-a79f-6145f5108c18 service nova] [instance: 29f5d275-78e7-4292-98c8-d12f47f28fbf] Received unexpected event network-vif-plugged-9fd51c5f-2f3b-4df5-92c8-3d84fe37691b for instance with vm_state deleted and task_state None.
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:41:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.764s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:01 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Deleted allocations for instance 29f5d275-78e7-4292-98c8-d12f47f28fbf
Nov 11 01:41:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7c212c3b-01f6-4b68-9a76-d9fa4ce3c093 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "29f5d275-78e7-4292-98c8-d12f47f28fbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.950s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:41:08 user nova-compute[75215]: INFO nova.compute.claims [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Claim successful on node user
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.120s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'pci_requests' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'numa_topology' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:41:08 user nova-compute[75215]: INFO nova.compute.claims [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Claim successful on node user
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:41:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.policy [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c11f7630148412285910f06eade4923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddded455ac3456e9316603170bb6fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:41:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Creating image(s)
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.046s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:41:09 user nova-compute[75215]: INFO nova.compute.claims [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Claim successful on node user
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:09 user nova-compute[75215]: INFO nova.network.neutron [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating port c546474a-e342-4eee-8398-789477c6a76d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk 1073741824" returned: 0 in 0.073s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Successfully created port: 5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.221s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Cannot resize image /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.715s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:41:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.policy [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c11f7630148412285910f06eade4923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddded455ac3456e9316603170bb6fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:41:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Creating image(s)
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Successfully updated port: 5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquired lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquired lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-6211cbfe-e8b7-41d8-a0ae-c41606794683 req-8273a93c-77d3-4e7f-acda-39881446f518 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-changed-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-6211cbfe-e8b7-41d8-a0ae-c41606794683 req-8273a93c-77d3-4e7f-acda-39881446f518 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Refreshing instance network info cache due to event network-changed-5108ba03-5c01-43b3-b46d-9ed376611b44. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6211cbfe-e8b7-41d8-a0ae-c41606794683 req-8273a93c-77d3-4e7f-acda-39881446f518 service nova] Acquiring lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Successfully created port: 3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk 1073741824" returned: 0 in 0.068s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Releasing lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance network_info: |[{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6211cbfe-e8b7-41d8-a0ae-c41606794683 req-8273a93c-77d3-4e7f-acda-39881446f518 service nova] Acquired lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.neutron [req-6211cbfe-e8b7-41d8-a0ae-c41606794683 req-8273a93c-77d3-4e7f-acda-39881446f518 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Refreshing network info cache for port 5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Start _get_guest_xml network_info=[{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Cannot resize image /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Ensure instance console log exists: /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:11 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:11 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1868885677',display_name='tempest-ServerRescueNegativeTestJSON-server-1868885677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1868885677',id=24,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-6hfs45g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:09Z,user_data=None,user_id='2c11f7630148412285910f06eade4923',uuid=6bd67e17-1262-4cf5-83cf-5de6852e5d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e6:b0,bridge_name='br-int',has_traffic_filtering=True,id=5108ba03-5c01-43b3-b46d-9ed376611b44,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5108ba03-5c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:41:11 user nova-compute[75215]:   <uuid>6bd67e17-1262-4cf5-83cf-5de6852e5d7e</uuid>
Nov 11 01:41:11 user nova-compute[75215]:   <name>instance-00000018</name>
Nov 11 01:41:11 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:41:11 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:41:11 user nova-compute[75215]:   <metadata>
Nov 11 01:41:11 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:41:11 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:41:11 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1868885677</nova:name>
Nov 11 01:41:11 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:41:11</nova:creationTime>
Nov 11 01:41:11 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:41:11 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:41:11 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:41:11 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:41:11 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:41:11 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:41:11 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:41:11 user nova-compute[75215]:       <nova:owner>
Nov 11 01:41:11 user nova-compute[75215]:         <nova:user uuid="2c11f7630148412285910f06eade4923">tempest-ServerRescueNegativeTestJSON-107483545-project-member</nova:user>
Nov 11 01:41:11 user nova-compute[75215]:         <nova:project uuid="dddded455ac3456e9316603170bb6fea">tempest-ServerRescueNegativeTestJSON-107483545</nova:project>
Nov 11 01:41:11 user nova-compute[75215]:       </nova:owner>
Nov 11 01:41:11 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:41:11 user nova-compute[75215]:       <nova:ports>
Nov 11 01:41:11 user nova-compute[75215]:         <nova:port uuid="5108ba03-5c01-43b3-b46d-9ed376611b44">
Nov 11 01:41:11 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 11 01:41:11 user nova-compute[75215]:         </nova:port>
Nov 11 01:41:11 user nova-compute[75215]:       </nova:ports>
Nov 11 01:41:11 user nova-compute[75215]:     </nova:instance>
Nov 11 01:41:11 user nova-compute[75215]:   </metadata>
Nov 11 01:41:11 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:41:11 user nova-compute[75215]:     <system>
Nov 11 01:41:11 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:41:11 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:41:11 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:41:11 user nova-compute[75215]:       <entry name="serial">6bd67e17-1262-4cf5-83cf-5de6852e5d7e</entry>
Nov 11 01:41:11 user nova-compute[75215]:       <entry name="uuid">6bd67e17-1262-4cf5-83cf-5de6852e5d7e</entry>
Nov 11 01:41:11 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:41:11 user nova-compute[75215]:     </system>
Nov 11 01:41:11 user nova-compute[75215]:   </sysinfo>
Nov 11 01:41:11 user nova-compute[75215]:   <os>
Nov 11 01:41:11 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:41:11 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:41:11 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:41:11 user nova-compute[75215]:   </os>
Nov 11 01:41:11 user nova-compute[75215]:   <features>
Nov 11 01:41:11 user nova-compute[75215]:     <acpi/>
Nov 11 01:41:11 user nova-compute[75215]:     <apic/>
Nov 11 01:41:11 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:41:11 user nova-compute[75215]:   </features>
Nov 11 01:41:11 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:41:11 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:41:11 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:41:11 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:41:11 user nova-compute[75215]:   </clock>
Nov 11 01:41:11 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:41:11 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:41:11 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:41:11 user nova-compute[75215]:   </cpu>
Nov 11 01:41:11 user nova-compute[75215]:   <devices>
Nov 11 01:41:11 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:41:11 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:41:11 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk"/>
Nov 11 01:41:11 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:41:11 user nova-compute[75215]:     </disk>
Nov 11 01:41:11 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:41:11 user nova-compute[75215]:       <mac address="fa:16:3e:21:e6:b0"/>
Nov 11 01:41:11 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:41:11 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:41:11 user nova-compute[75215]:       <target dev="tap5108ba03-5c"/>
Nov 11 01:41:11 user nova-compute[75215]:     </interface>
Nov 11 01:41:11 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:41:11 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/console.log" append="off"/>
Nov 11 01:41:11 user nova-compute[75215]:     </serial>
Nov 11 01:41:11 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:41:11 user nova-compute[75215]:     <video>
Nov 11 01:41:11 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:41:11 user nova-compute[75215]:     </video>
Nov 11 01:41:11 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:41:11 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:41:11 user nova-compute[75215]:     </rng>
Nov 11 01:41:11 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:41:11 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:41:11 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:41:11 user nova-compute[75215]:     </memballoon>
Nov 11 01:41:11 user nova-compute[75215]:   </devices>
Nov 11 01:41:11 user nova-compute[75215]: </domain>
Nov 11 01:41:11 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1868885677',display_name='tempest-ServerRescueNegativeTestJSON-server-1868885677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1868885677',id=24,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-6hfs45g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:09Z,user_data=None,user_id='2c11f7630148412285910f06eade4923',uuid=6bd67e17-1262-4cf5-83cf-5de6852e5d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e6:b0,bridge_name='br-int',has_traffic_filtering=True,id=5108ba03-5c01-43b3-b46d-9ed376611b44,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5108ba03-5c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG os_vif [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e6:b0,bridge_name='br-int',has_traffic_filtering=True,id=5108ba03-5c01-43b3-b46d-9ed376611b44,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5108ba03-5c') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9268531-8dc8-5f1c-ac15-c38d103c1dac', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5108ba03-5c, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5108ba03-5c, col_values=(('qos', UUID('c32cc0bb-b202-4d88-bf66-d8d0960ef3a4')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5108ba03-5c, col_values=(('external_ids', {'iface-id': '5108ba03-5c01-43b3-b46d-9ed376611b44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:e6:b0', 'vm-uuid': '6bd67e17-1262-4cf5-83cf-5de6852e5d7e'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:11 user nova-compute[75215]: INFO os_vif [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e6:b0,bridge_name='br-int',has_traffic_filtering=True,id=5108ba03-5c01-43b3-b46d-9ed376611b44,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5108ba03-5c')
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No VIF found with MAC fa:16:3e:21:e6:b0, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Successfully updated port: 3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Releasing lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:41:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Creating image(s)
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'trusted_certs' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquired lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.objects.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<c26d1d9c-4086-4d2a-9551-b1c4b388b0ea> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "aa60511f7e83891e863bae675edd19b466c13093" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "aa60511f7e83891e863bae675edd19b466c13093" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-1bdf4a78-1af8-479a-8c2b-a1d33aa914ab req-7369e972-4083-4335-b054-397cc36d149f service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-changed-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-1bdf4a78-1af8-479a-8c2b-a1d33aa914ab req-7369e972-4083-4335-b054-397cc36d149f service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Refreshing instance network info cache due to event network-changed-3cc562bf-7bac-40d7-b6ee-db41336f434b. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1bdf4a78-1af8-479a-8c2b-a1d33aa914ab req-7369e972-4083-4335-b054-397cc36d149f service nova] Acquiring lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-6211cbfe-e8b7-41d8-a0ae-c41606794683 req-8273a93c-77d3-4e7f-acda-39881446f518 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updated VIF entry in instance network info cache for port 5108ba03-5c01-43b3-b46d-9ed376611b44. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-6211cbfe-e8b7-41d8-a0ae-c41606794683 req-8273a93c-77d3-4e7f-acda-39881446f518 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6211cbfe-e8b7-41d8-a0ae-c41606794683 req-8273a93c-77d3-4e7f-acda-39881446f518 service nova] Releasing lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.images [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] e467fb72-9153-4fa5-a6d2-ed58f69cba85 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093.part /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.network.neutron [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updating instance_info_cache with network_info: [{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-6b80f307-4369-44f4-ad77-19a6ac7dfc3e req-1e841c79-54dd-4b89-8be6-c6d74df79a79 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-changed-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-6b80f307-4369-44f4-ad77-19a6ac7dfc3e req-1e841c79-54dd-4b89-8be6-c6d74df79a79 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Refreshing instance network info cache due to event network-changed-c546474a-e342-4eee-8398-789477c6a76d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b80f307-4369-44f4-ad77-19a6ac7dfc3e req-1e841c79-54dd-4b89-8be6-c6d74df79a79 service nova] Acquiring lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b80f307-4369-44f4-ad77-19a6ac7dfc3e req-1e841c79-54dd-4b89-8be6-c6d74df79a79 service nova] Acquired lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-6b80f307-4369-44f4-ad77-19a6ac7dfc3e req-1e841c79-54dd-4b89-8be6-c6d74df79a79 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Refreshing network info cache for port c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Releasing lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Instance network_info: |[{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1bdf4a78-1af8-479a-8c2b-a1d33aa914ab req-7369e972-4083-4335-b054-397cc36d149f service nova] Acquired lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-1bdf4a78-1af8-479a-8c2b-a1d33aa914ab req-7369e972-4083-4335-b054-397cc36d149f service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Refreshing network info cache for port 3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Start _get_guest_xml network_info=[{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:41:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:12 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752797510',display_name='tempest-ServerRescueNegativeTestJSON-server-1752797510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752797510',id=25,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-xrgv02un',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:10Z,user_data=None,user_id='2c11f7630148412285910f06eade4923',uuid=2797cb1b-a56d-47c4-9810-4d5cd424c4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:64:a6,bridge_name='br-int',has_traffic_filtering=True,id=3cc562bf-7bac-40d7-b6ee-db41336f434b,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc562bf-7b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.objects.instance [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'pci_devices' on Instance uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093.part /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093.converted" returned: 0 in 0.483s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-a043827f-ecaf-4566-aa0f-41a23bf8a76e req-d9b82cc1-f4f6-4b23-96c0-8566575fe78a service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a043827f-ecaf-4566-aa0f-41a23bf8a76e req-d9b82cc1-f4f6-4b23-96c0-8566575fe78a service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a043827f-ecaf-4566-aa0f-41a23bf8a76e req-d9b82cc1-f4f6-4b23-96c0-8566575fe78a service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a043827f-ecaf-4566-aa0f-41a23bf8a76e req-d9b82cc1-f4f6-4b23-96c0-8566575fe78a service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-a043827f-ecaf-4566-aa0f-41a23bf8a76e req-d9b82cc1-f4f6-4b23-96c0-8566575fe78a service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:12 user nova-compute[75215]: WARNING nova.compute.manager [req-a043827f-ecaf-4566-aa0f-41a23bf8a76e req-d9b82cc1-f4f6-4b23-96c0-8566575fe78a service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state building and task_state spawning.
Nov 11 01:41:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:41:13 user nova-compute[75215]:   <uuid>2797cb1b-a56d-47c4-9810-4d5cd424c4e9</uuid>
Nov 11 01:41:13 user nova-compute[75215]:   <name>instance-00000019</name>
Nov 11 01:41:13 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:41:13 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:41:13 user nova-compute[75215]:   <metadata>
Nov 11 01:41:13 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:41:13 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:41:13 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1752797510</nova:name>
Nov 11 01:41:13 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:41:12</nova:creationTime>
Nov 11 01:41:13 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:41:13 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:41:13 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:41:13 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:41:13 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:41:13 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:41:13 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:41:13 user nova-compute[75215]:       <nova:owner>
Nov 11 01:41:13 user nova-compute[75215]:         <nova:user uuid="2c11f7630148412285910f06eade4923">tempest-ServerRescueNegativeTestJSON-107483545-project-member</nova:user>
Nov 11 01:41:13 user nova-compute[75215]:         <nova:project uuid="dddded455ac3456e9316603170bb6fea">tempest-ServerRescueNegativeTestJSON-107483545</nova:project>
Nov 11 01:41:13 user nova-compute[75215]:       </nova:owner>
Nov 11 01:41:13 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:41:13 user nova-compute[75215]:       <nova:ports>
Nov 11 01:41:13 user nova-compute[75215]:         <nova:port uuid="3cc562bf-7bac-40d7-b6ee-db41336f434b">
Nov 11 01:41:13 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:41:13 user nova-compute[75215]:         </nova:port>
Nov 11 01:41:13 user nova-compute[75215]:       </nova:ports>
Nov 11 01:41:13 user nova-compute[75215]:     </nova:instance>
Nov 11 01:41:13 user nova-compute[75215]:   </metadata>
Nov 11 01:41:13 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:41:13 user nova-compute[75215]:     <system>
Nov 11 01:41:13 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:41:13 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:41:13 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:41:13 user nova-compute[75215]:       <entry name="serial">2797cb1b-a56d-47c4-9810-4d5cd424c4e9</entry>
Nov 11 01:41:13 user nova-compute[75215]:       <entry name="uuid">2797cb1b-a56d-47c4-9810-4d5cd424c4e9</entry>
Nov 11 01:41:13 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:41:13 user nova-compute[75215]:     </system>
Nov 11 01:41:13 user nova-compute[75215]:   </sysinfo>
Nov 11 01:41:13 user nova-compute[75215]:   <os>
Nov 11 01:41:13 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:41:13 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:41:13 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:41:13 user nova-compute[75215]:   </os>
Nov 11 01:41:13 user nova-compute[75215]:   <features>
Nov 11 01:41:13 user nova-compute[75215]:     <acpi/>
Nov 11 01:41:13 user nova-compute[75215]:     <apic/>
Nov 11 01:41:13 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:41:13 user nova-compute[75215]:   </features>
Nov 11 01:41:13 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:41:13 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:41:13 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:41:13 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:41:13 user nova-compute[75215]:   </clock>
Nov 11 01:41:13 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:41:13 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:41:13 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:41:13 user nova-compute[75215]:   </cpu>
Nov 11 01:41:13 user nova-compute[75215]:   <devices>
Nov 11 01:41:13 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:41:13 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:41:13 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk"/>
Nov 11 01:41:13 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:41:13 user nova-compute[75215]:     </disk>
Nov 11 01:41:13 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:41:13 user nova-compute[75215]:       <mac address="fa:16:3e:92:64:a6"/>
Nov 11 01:41:13 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:41:13 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:41:13 user nova-compute[75215]:       <target dev="tap3cc562bf-7b"/>
Nov 11 01:41:13 user nova-compute[75215]:     </interface>
Nov 11 01:41:13 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:41:13 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/console.log" append="off"/>
Nov 11 01:41:13 user nova-compute[75215]:     </serial>
Nov 11 01:41:13 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:41:13 user nova-compute[75215]:     <video>
Nov 11 01:41:13 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:41:13 user nova-compute[75215]:     </video>
Nov 11 01:41:13 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:41:13 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:41:13 user nova-compute[75215]:     </rng>
Nov 11 01:41:13 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:41:13 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:41:13 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:41:13 user nova-compute[75215]:     </memballoon>
Nov 11 01:41:13 user nova-compute[75215]:   </devices>
Nov 11 01:41:13 user nova-compute[75215]: </domain>
Nov 11 01:41:13 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752797510',display_name='tempest-ServerRescueNegativeTestJSON-server-1752797510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752797510',id=25,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-xrgv02un',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:10Z,user_data=None,user_id='2c11f7630148412285910f06eade4923',uuid=2797cb1b-a56d-47c4-9810-4d5cd424c4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:64:a6,bridge_name='br-int',has_traffic_filtering=True,id=3cc562bf-7bac-40d7-b6ee-db41336f434b,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc562bf-7b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG os_vif [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:64:a6,bridge_name='br-int',has_traffic_filtering=True,id=3cc562bf-7bac-40d7-b6ee-db41336f434b,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc562bf-7b') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48aea29c-aee6-56b6-9a54-4cf8157f1789', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cc562bf-7b, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cc562bf-7b, col_values=(('qos', UUID('3d069f7d-774c-420b-bdd0-f679094537b6')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cc562bf-7b, col_values=(('external_ids', {'iface-id': '3cc562bf-7bac-40d7-b6ee-db41336f434b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:64:a6', 'vm-uuid': '2797cb1b-a56d-47c4-9810-4d5cd424c4e9'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: INFO os_vif [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:64:a6,bridge_name='br-int',has_traffic_filtering=True,id=3cc562bf-7bac-40d7-b6ee-db41336f434b,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc562bf-7b')
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No VIF found with MAC fa:16:3e:92:64:a6, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093.converted --force-share --output=json" returned: 0 in 0.259s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "aa60511f7e83891e863bae675edd19b466c13093" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.889s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093 --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "aa60511f7e83891e863bae675edd19b466c13093" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "aa60511f7e83891e863bae675edd19b466c13093" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093 --force-share --output=json" returned: 0 in 0.227s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093,backing_fmt=raw /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-6b80f307-4369-44f4-ad77-19a6ac7dfc3e req-1e841c79-54dd-4b89-8be6-c6d74df79a79 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updated VIF entry in instance network info cache for port c546474a-e342-4eee-8398-789477c6a76d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-6b80f307-4369-44f4-ad77-19a6ac7dfc3e req-1e841c79-54dd-4b89-8be6-c6d74df79a79 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-1bdf4a78-1af8-479a-8c2b-a1d33aa914ab req-7369e972-4083-4335-b054-397cc36d149f service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updated VIF entry in instance network info cache for port 3cc562bf-7bac-40d7-b6ee-db41336f434b. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-1bdf4a78-1af8-479a-8c2b-a1d33aa914ab req-7369e972-4083-4335-b054-397cc36d149f service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updating instance_info_cache with network_info: [{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093,backing_fmt=raw /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk 1073741824" returned: 0 in 0.054s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "aa60511f7e83891e863bae675edd19b466c13093" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b80f307-4369-44f4-ad77-19a6ac7dfc3e req-1e841c79-54dd-4b89-8be6-c6d74df79a79 service nova] Releasing lock "refresh_cache-c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1bdf4a78-1af8-479a-8c2b-a1d33aa914ab req-7369e972-4083-4335-b054-397cc36d149f service nova] Releasing lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093 --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'migration_context' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:13 user nova-compute[75215]: DEBUG nova.objects.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<c26d1d9c-4086-4d2a-9551-b1c4b388b0ea> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:41:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Rebasing disk image.
Nov 11 01:41:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 -F raw /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:41:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance spawned successfully.
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:14 user nova-compute[75215]: WARNING nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state building and task_state spawning.
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] No waiting events found dispatching network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:14 user nova-compute[75215]: WARNING nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received unexpected event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b for instance with vm_state building and task_state spawning.
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] No waiting events found dispatching network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:14 user nova-compute[75215]: WARNING nova.compute.manager [req-5c0034b9-41ce-450e-9135-0c9e1f478faa req-a9dfa95b-3807-44ce-89bf-750c32ee2f28 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received unexpected event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b for instance with vm_state building and task_state spawning.
Nov 11 01:41:15 user nova-compute[75215]: INFO nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 11 01:41:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:41:15 user nova-compute[75215]: INFO nova.compute.manager [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Took 7.71 seconds to build instance.
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3356ef09-b422-4768-8f57-2fb110e81c8d tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.395s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 -F raw /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk" returned: 0 in 2.822s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Ensure instance console log exists: /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Start _get_guest_xml network_info=[{"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='f067bf231a18353e88bb4c206e32a34f',container_format='bare',created_at=2023-11-11T01:38:23Z,direct_url=<?>,disk_format='qcow2',id=e467fb72-9153-4fa5-a6d2-ed58f69cba85,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-50013957-shelved',owner='739153e36b674c839c8d7bb97201e4aa',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T01:38:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '36652f41-a61d-46ca-9ced-57e68928a2bd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZvKqMsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c26d1d9c-4086-4d2a-9551-b1c4b388b0ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'be297bd8-4300-4833-a3a0-dbe6e12ab4ad', 'serial': 'be297bd8-4300-4833-a3a0-dbe6e12ab4ad'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:41:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f067bf231a18353e88bb4c206e32a34f',container_format='bare',created_at=2023-11-11T01:38:23Z,direct_url=<?>,disk_format='qcow2',id=e467fb72-9153-4fa5-a6d2-ed58f69cba85,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-50013957-shelved',owner='739153e36b674c839c8d7bb97201e4aa',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T01:38:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'vcpu_model' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.objects.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<c26d1d9c-4086-4d2a-9551-b1c4b388b0ea> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZvKqMsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:41:16 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:41:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:41:16 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:41:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:41:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:41:16 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:41:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260" returned: 21 in 0.070s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e11b81-4045-441a-9508-64da9fc29d8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:41:17 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3efc339-a288-4e1d-b8e9-8b821c1965bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad] added
Nov 11 01:41:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b438a-f892-48f8-9f91-b4bb7bbaee13]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.395s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb7e823-2d46-4c2c-8c1a-f28a89eddc7a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZvKqMsn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZvKqMsn" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[46044654-d55f-4fc7-81a4-daf388919168]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZvKqMsn'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ac5b9-1f22-4666-a066-d2e451543263]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a846e784-ba4e-48bf-9a8d-3def2af52c0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:41:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:41:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc7e514-ca53-45c4-b712-02f6152999cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad, portal: 172.16.0.220,3260]
Nov 11 01:41:17 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad, portal: 172.16.0.220,3260] successful.
Nov 11 01:41:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f053aef-82fa-402b-a1cf-f08e87954caf]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5d48f1-4b03-417a-95c1-30dd9a46c4aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:41:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:41:17 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:41:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.041s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebd95e4-4f01-437d-9e54-e6be7d1ddd7f]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZvKqMsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:41:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Instance spawned successfully.
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:17 user nova-compute[75215]: INFO nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Took 7.63 seconds to spawn the instance on the hypervisor.
Nov 11 01:41:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:41:17 user nova-compute[75215]: INFO nova.compute.manager [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Took 8.79 seconds to build instance.
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-187113ab-026d-4565-8302-6ea6e5f17916 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.951s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.548s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] <== connect_volume: return (1553ms) {'type': 'block', 'scsi_wwn': '23630383666383439', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630383666383439', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-50013957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-50013957',id=16,image_ref='e467fb72-9153-4fa5-a6d2-ed58f69cba85',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-118414557',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:36:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-fj250k7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member',shelved_at='2023-11-11T01:38:27.055224',shelved_host='user',shelved_image_id='e467fb72-9153-4fa5-a6d2-ed58f69cba85'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=c26d1d9c-4086-4d2a-9551-b1c4b388b0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'pci_devices' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4881a7c-23c0-41b3-9bf9-c730cc5683ec req-de09f2e8-5790-48fa-8b87-4f76a6aa3da6 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received event network-changed-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4881a7c-23c0-41b3-9bf9-c730cc5683ec req-de09f2e8-5790-48fa-8b87-4f76a6aa3da6 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Refreshing instance network info cache due to event network-changed-4c326aeb-0507-41eb-b3af-3800d713adf1. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e4881a7c-23c0-41b3-9bf9-c730cc5683ec req-de09f2e8-5790-48fa-8b87-4f76a6aa3da6 service nova] Acquiring lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e4881a7c-23c0-41b3-9bf9-c730cc5683ec req-de09f2e8-5790-48fa-8b87-4f76a6aa3da6 service nova] Acquired lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4881a7c-23c0-41b3-9bf9-c730cc5683ec req-de09f2e8-5790-48fa-8b87-4f76a6aa3da6 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Refreshing network info cache for port 4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.objects.base [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<c26d1d9c-4086-4d2a-9551-b1c4b388b0ea> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:41:18 user nova-compute[75215]:   <uuid>c26d1d9c-4086-4d2a-9551-b1c4b388b0ea</uuid>
Nov 11 01:41:18 user nova-compute[75215]:   <name>instance-00000010</name>
Nov 11 01:41:18 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:41:18 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:41:18 user nova-compute[75215]:   <metadata>
Nov 11 01:41:18 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:41:18 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:41:18 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-50013957</nova:name>
Nov 11 01:41:18 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:41:16</nova:creationTime>
Nov 11 01:41:18 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:41:18 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:41:18 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:41:18 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:41:18 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:41:18 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:41:18 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:41:18 user nova-compute[75215]:       <nova:owner>
Nov 11 01:41:18 user nova-compute[75215]:         <nova:user uuid="11c0895e92ca4572b6f004d360f18eaf">tempest-AttachVolumeShelveTestJSON-1029212070-project-member</nova:user>
Nov 11 01:41:18 user nova-compute[75215]:         <nova:project uuid="739153e36b674c839c8d7bb97201e4aa">tempest-AttachVolumeShelveTestJSON-1029212070</nova:project>
Nov 11 01:41:18 user nova-compute[75215]:       </nova:owner>
Nov 11 01:41:18 user nova-compute[75215]:       <nova:root type="image" uuid="e467fb72-9153-4fa5-a6d2-ed58f69cba85"/>
Nov 11 01:41:18 user nova-compute[75215]:       <nova:ports>
Nov 11 01:41:18 user nova-compute[75215]:         <nova:port uuid="c546474a-e342-4eee-8398-789477c6a76d">
Nov 11 01:41:18 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:41:18 user nova-compute[75215]:         </nova:port>
Nov 11 01:41:18 user nova-compute[75215]:       </nova:ports>
Nov 11 01:41:18 user nova-compute[75215]:     </nova:instance>
Nov 11 01:41:18 user nova-compute[75215]:   </metadata>
Nov 11 01:41:18 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:41:18 user nova-compute[75215]:     <system>
Nov 11 01:41:18 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:41:18 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:41:18 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:41:18 user nova-compute[75215]:       <entry name="serial">c26d1d9c-4086-4d2a-9551-b1c4b388b0ea</entry>
Nov 11 01:41:18 user nova-compute[75215]:       <entry name="uuid">c26d1d9c-4086-4d2a-9551-b1c4b388b0ea</entry>
Nov 11 01:41:18 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:41:18 user nova-compute[75215]:     </system>
Nov 11 01:41:18 user nova-compute[75215]:   </sysinfo>
Nov 11 01:41:18 user nova-compute[75215]:   <os>
Nov 11 01:41:18 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:41:18 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:41:18 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:41:18 user nova-compute[75215]:   </os>
Nov 11 01:41:18 user nova-compute[75215]:   <features>
Nov 11 01:41:18 user nova-compute[75215]:     <acpi/>
Nov 11 01:41:18 user nova-compute[75215]:     <apic/>
Nov 11 01:41:18 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:41:18 user nova-compute[75215]:   </features>
Nov 11 01:41:18 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:41:18 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:41:18 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:41:18 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:41:18 user nova-compute[75215]:   </clock>
Nov 11 01:41:18 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:41:18 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:41:18 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:41:18 user nova-compute[75215]:   </cpu>
Nov 11 01:41:18 user nova-compute[75215]:   <devices>
Nov 11 01:41:18 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:41:18 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:41:18 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk"/>
Nov 11 01:41:18 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:41:18 user nova-compute[75215]:     </disk>
Nov 11 01:41:18 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:41:18 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:41:18 user nova-compute[75215]:       <source dev="/dev/sde"/>
Nov 11 01:41:18 user nova-compute[75215]:       <target dev="vdc" bus="virtio"/>
Nov 11 01:41:18 user nova-compute[75215]:       <serial>be297bd8-4300-4833-a3a0-dbe6e12ab4ad</serial>
Nov 11 01:41:18 user nova-compute[75215]:     </disk>
Nov 11 01:41:18 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:41:18 user nova-compute[75215]:       <mac address="fa:16:3e:2a:54:ac"/>
Nov 11 01:41:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:41:18 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:41:18 user nova-compute[75215]:       <target dev="tapc546474a-e3"/>
Nov 11 01:41:18 user nova-compute[75215]:     </interface>
Nov 11 01:41:18 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:41:18 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/console.log" append="off"/>
Nov 11 01:41:18 user nova-compute[75215]:     </serial>
Nov 11 01:41:18 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:41:18 user nova-compute[75215]:     <video>
Nov 11 01:41:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:41:18 user nova-compute[75215]:     </video>
Nov 11 01:41:18 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:41:18 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:41:18 user nova-compute[75215]:     </rng>
Nov 11 01:41:18 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:41:18 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:41:18 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:41:18 user nova-compute[75215]:     </memballoon>
Nov 11 01:41:18 user nova-compute[75215]:   </devices>
Nov 11 01:41:18 user nova-compute[75215]: </domain>
Nov 11 01:41:18 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-50013957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-50013957',id=16,image_ref='e467fb72-9153-4fa5-a6d2-ed58f69cba85',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-118414557',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:36:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-fj250k7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member',shelved_at='2023-11-11T01:38:27.055224',shelved_host='user',shelved_image_id='e467fb72-9153-4fa5-a6d2-ed58f69cba85'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=c26d1d9c-4086-4d2a-9551-b1c4b388b0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG os_vif [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff93b3b2-8831-5399-a63a-e91818752fd5', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc546474a-e3, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc546474a-e3, col_values=(('qos', UUID('34cd55b3-760d-4619-abff-4bfa3b5120c9')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc546474a-e3, col_values=(('external_ids', {'iface-id': 'c546474a-e342-4eee-8398-789477c6a76d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:54:ac', 'vm-uuid': 'c26d1d9c-4086-4d2a-9551-b1c4b388b0ea'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:18 user nova-compute[75215]: INFO os_vif [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3')
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No VIF found with MAC fa:16:3e:2a:54:ac, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4881a7c-23c0-41b3-9bf9-c730cc5683ec req-de09f2e8-5790-48fa-8b87-4f76a6aa3da6 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Updated VIF entry in instance network info cache for port 4c326aeb-0507-41eb-b3af-3800d713adf1. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4881a7c-23c0-41b3-9bf9-c730cc5683ec req-de09f2e8-5790-48fa-8b87-4f76a6aa3da6 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Updating instance_info_cache with network_info: [{"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e4881a7c-23c0-41b3-9bf9-c730cc5683ec req-de09f2e8-5790-48fa-8b87-4f76a6aa3da6 service nova] Releasing lock "refresh_cache-323cc88a-b1b3-4a44-9674-818ba3e317f2" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:41:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:41:20 user nova-compute[75215]: INFO nova.compute.manager [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] instance snapshotting
Nov 11 01:41:20 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Beginning live snapshot process
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-a73c3589-72ae-4e35-b76d-90e6b166c25a req-e97400ba-502c-4a72-9169-cf6229af92f3 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a73c3589-72ae-4e35-b76d-90e6b166c25a req-e97400ba-502c-4a72-9169-cf6229af92f3 service nova] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a73c3589-72ae-4e35-b76d-90e6b166c25a req-e97400ba-502c-4a72-9169-cf6229af92f3 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a73c3589-72ae-4e35-b76d-90e6b166c25a req-e97400ba-502c-4a72-9169-cf6229af92f3 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-a73c3589-72ae-4e35-b76d-90e6b166c25a req-e97400ba-502c-4a72-9169-cf6229af92f3 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] No waiting events found dispatching network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:20 user nova-compute[75215]: WARNING nova.compute.manager [req-a73c3589-72ae-4e35-b76d-90e6b166c25a req-e97400ba-502c-4a72-9169-cf6229af92f3 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received unexpected event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 01:41:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb80d5ad-622f-42c0-93f7-bd605d9f8e40 req-340ef5b2-1146-4b55-9239-3a9a0095b575 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb80d5ad-622f-42c0-93f7-bd605d9f8e40 req-340ef5b2-1146-4b55-9239-3a9a0095b575 service nova] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb80d5ad-622f-42c0-93f7-bd605d9f8e40 req-340ef5b2-1146-4b55-9239-3a9a0095b575 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb80d5ad-622f-42c0-93f7-bd605d9f8e40 req-340ef5b2-1146-4b55-9239-3a9a0095b575 service nova] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb80d5ad-622f-42c0-93f7-bd605d9f8e40 req-340ef5b2-1146-4b55-9239-3a9a0095b575 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] No waiting events found dispatching network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:23 user nova-compute[75215]: WARNING nova.compute.manager [req-bb80d5ad-622f-42c0-93f7-bd605d9f8e40 req-340ef5b2-1146-4b55-9239-3a9a0095b575 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received unexpected event network-vif-plugged-c546474a-e342-4eee-8398-789477c6a76d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json -f qcow2" returned: 0 in 2.874s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:23 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:23 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7811MB free_disk=25.212692260742188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance spawned successfully.
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.231s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1wgsjut_/eca9f1045dfe4937addb1bd96329cc6f.delta 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance e6560dd5-4f17-417d-bb0c-269e0284207d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 323cc88a-b1b3-4a44-9674-818ba3e317f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d48231dc-e985-40ec-a122-fa4a24618e8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d4069c05-e0f6-4cda-a48f-ad6318f28710): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1wgsjut_/eca9f1045dfe4937addb1bd96329cc6f.delta 1073741824" returned: 0 in 0.102s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-7d16e886-6456-4b6c-a6a4-68e2dd798b8f req-8b1a92ef-fd4d-432c-8d96-31273ee5aa93 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received event network-changed-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-7d16e886-6456-4b6c-a6a4-68e2dd798b8f req-8b1a92ef-fd4d-432c-8d96-31273ee5aa93 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Refreshing instance network info cache due to event network-changed-f60519c0-e63a-490a-82cb-60c9aef6020d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d16e886-6456-4b6c-a6a4-68e2dd798b8f req-8b1a92ef-fd4d-432c-8d96-31273ee5aa93 service nova] Acquiring lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d16e886-6456-4b6c-a6a4-68e2dd798b8f req-8b1a92ef-fd4d-432c-8d96-31273ee5aa93 service nova] Acquired lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-7d16e886-6456-4b6c-a6a4-68e2dd798b8f req-8b1a92ef-fd4d-432c-8d96-31273ee5aa93 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Refreshing network info cache for port f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:41:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 11 01:41:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c40fce4-c23d-46a9-a07a-f109ee3aac35 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 68.779s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.933s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-7d16e886-6456-4b6c-a6a4-68e2dd798b8f req-8b1a92ef-fd4d-432c-8d96-31273ee5aa93 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Updated VIF entry in instance network info cache for port f60519c0-e63a-490a-82cb-60c9aef6020d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-7d16e886-6456-4b6c-a6a4-68e2dd798b8f req-8b1a92ef-fd4d-432c-8d96-31273ee5aa93 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Updating instance_info_cache with network_info: [{"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7d16e886-6456-4b6c-a6a4-68e2dd798b8f req-8b1a92ef-fd4d-432c-8d96-31273ee5aa93 service nova] Releasing lock "refresh_cache-d207b4de-98f2-41ce-ba8f-af7583b6bb76" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 01:41:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 01:41:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 01:41:25 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:41:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1wgsjut_/eca9f1045dfe4937addb1bd96329cc6f.delta /opt/stack/data/nova/instances/snapshots/tmp1wgsjut_/eca9f1045dfe4937addb1bd96329cc6f {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1wgsjut_/eca9f1045dfe4937addb1bd96329cc6f.delta /opt/stack/data/nova/instances/snapshots/tmp1wgsjut_/eca9f1045dfe4937addb1bd96329cc6f" returned: 0 in 0.348s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Snapshot extracted, beginning image upload
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:41:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:41:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Snapshot image upload complete
Nov 11 01:41:29 user nova-compute[75215]: INFO nova.compute.manager [None req-2bfd71b7-aed5-4768-a1b5-2f1675847151 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Took 8.94 seconds to snapshot the instance on the hypervisor.
Nov 11 01:41:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid d207b4de-98f2-41ce-ba8f-af7583b6bb76 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:31 user nova-compute[75215]: INFO nova.compute.manager [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Attaching volume 7942f82a-eb3a-43e7-8d67-3f2f1636dc8f to /dev/vdb
Nov 11 01:41:31 user nova-compute[75215]: DEBUG os_brick.utils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1673a071-c174-4038-8006-959d232cc1af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d23a7-fc79-4239-8b2d-4e5e243cae6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b170ed9-22b9-4c6c-9c83-afc4579cc9fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db28f0f8-8242-4261-8f0a-4dfb5e06a960]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:41:31 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:41:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c791e5-bf7b-41dd-b31a-f593d07e5058]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG os_brick.utils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:41:31 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Updating existing volume attachment record: a8186a50-a034-49fa-8b98-8e32758506e2 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:41:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:41:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:41:42 user nova-compute[75215]: INFO nova.compute.claims [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Claim successful on node user
Nov 11 01:41:42 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:41:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:41:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:41:43 user nova-compute[75215]: INFO nova.virt.block_device [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Booting with volume 42983526-ca9e-4973-8891-7830b5f2fc1e at /dev/vda
Nov 11 01:41:43 user nova-compute[75215]: DEBUG nova.policy [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44e25bace5db43638b4eedfeb9215e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6fb80bd889f488bbfa25060dca25bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG os_brick.utils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5775edc-62f3-4f62-8fe9-3b154aaa14b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88256e58-d9c5-40dc-8d3e-9044b733c0f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4775d0c4-1d39-4c95-9808-2687302fb3cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a0d042-541f-46fa-82b4-4126f80b6ecc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:41:43 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:41:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fda230b-a417-4edd-8474-8d0b59e78413]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG os_brick.utils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating existing volume attachment record: 3ca14d12-d83a-4b69-a47b-185399db420b {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Successfully created port: 404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Successfully updated port: 404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquired lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-fbe928ab-48c8-4d8b-9b29-2c19dcca6dee req-f44d22b7-0c0d-4a59-8eec-49d25de1ce90 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-changed-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-fbe928ab-48c8-4d8b-9b29-2c19dcca6dee req-f44d22b7-0c0d-4a59-8eec-49d25de1ce90 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Refreshing instance network info cache due to event network-changed-404153aa-e572-4f64-a3c7-c474c6811610. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbe928ab-48c8-4d8b-9b29-2c19dcca6dee req-f44d22b7-0c0d-4a59-8eec-49d25de1ce90 service nova] Acquiring lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating instance_info_cache with network_info: [{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Releasing lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance network_info: |[{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbe928ab-48c8-4d8b-9b29-2c19dcca6dee req-f44d22b7-0c0d-4a59-8eec-49d25de1ce90 service nova] Acquired lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-fbe928ab-48c8-4d8b-9b29-2c19dcca6dee req-f44d22b7-0c0d-4a59-8eec-49d25de1ce90 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Refreshing network info cache for port 404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:41:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-fbe928ab-48c8-4d8b-9b29-2c19dcca6dee req-f44d22b7-0c0d-4a59-8eec-49d25de1ce90 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updated VIF entry in instance network info cache for port 404153aa-e572-4f64-a3c7-c474c6811610. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:41:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-fbe928ab-48c8-4d8b-9b29-2c19dcca6dee req-f44d22b7-0c0d-4a59-8eec-49d25de1ce90 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating instance_info_cache with network_info: [{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fbe928ab-48c8-4d8b-9b29-2c19dcca6dee req-f44d22b7-0c0d-4a59-8eec-49d25de1ce90 service nova] Releasing lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:41:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:41:49 user nova-compute[75215]: INFO nova.compute.claims [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Claim successful on node user
Nov 11 01:41:50 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:41:50 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:41:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:41:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:41:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:41:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:41:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:41:50 user nova-compute[75215]: INFO nova.virt.block_device [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Booting with volume-backed-image ff07f7e9-c859-41fd-adb3-c436d43c7526 at /dev/vda
Nov 11 01:41:50 user nova-compute[75215]: DEBUG nova.policy [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '561ad55121d44be1ab7971a495b9347f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32564a70b861419eaefcb97cd327088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:41:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Successfully created port: 79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:41:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Successfully updated port: 79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:41:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquired lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:41:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-80fb36bb-ab68-46f6-a63d-d188b8194377 req-a12473be-efd9-45a9-a808-389dde36cd67 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-changed-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-80fb36bb-ab68-46f6-a63d-d188b8194377 req-a12473be-efd9-45a9-a808-389dde36cd67 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Refreshing instance network info cache due to event network-changed-79fc7525-cd86-430b-a28f-40f2e0e6c0fe. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:41:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80fb36bb-ab68-46f6-a63d-d188b8194377 req-a12473be-efd9-45a9-a808-389dde36cd67 service nova] Acquiring lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Updating instance_info_cache with network_info: [{"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Releasing lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance network_info: |[{"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80fb36bb-ab68-46f6-a63d-d188b8194377 req-a12473be-efd9-45a9-a808-389dde36cd67 service nova] Acquired lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-80fb36bb-ab68-46f6-a63d-d188b8194377 req-a12473be-efd9-45a9-a808-389dde36cd67 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Refreshing network info cache for port 79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-80fb36bb-ab68-46f6-a63d-d188b8194377 req-a12473be-efd9-45a9-a808-389dde36cd67 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Updated VIF entry in instance network info cache for port 79fc7525-cd86-430b-a28f-40f2e0e6c0fe. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-80fb36bb-ab68-46f6-a63d-d188b8194377 req-a12473be-efd9-45a9-a808-389dde36cd67 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Updating instance_info_cache with network_info: [{"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80fb36bb-ab68-46f6-a63d-d188b8194377 req-a12473be-efd9-45a9-a808-389dde36cd67 service nova] Releasing lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:41:53 user nova-compute[75215]: INFO nova.compute.claims [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Claim successful on node user
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:41:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.policy [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '285cd483fbdc4e4faec7a1bbd414ca7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71c4317ced540a1a841f41cb9929b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:41:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Creating image(s)
Nov 11 01:41:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "/opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "/opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "/opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.315s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Successfully created port: 2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk 1073741824" returned: 0 in 0.055s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Cannot resize image /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Ensure instance console log exists: /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Successfully updated port: 2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquired lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-d5423887-a8f0-49eb-b55d-1e9860d877d9 req-b8f96ef3-d41d-4d93-8c2c-f2f0eef7ca9d service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-changed-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-d5423887-a8f0-49eb-b55d-1e9860d877d9 req-b8f96ef3-d41d-4d93-8c2c-f2f0eef7ca9d service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Refreshing instance network info cache due to event network-changed-2482e1e9-0789-46f8-a0c1-db7b0c189d46. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d5423887-a8f0-49eb-b55d-1e9860d877d9 req-b8f96ef3-d41d-4d93-8c2c-f2f0eef7ca9d service nova] Acquiring lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updating instance_info_cache with network_info: [{"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Releasing lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Instance network_info: |[{"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d5423887-a8f0-49eb-b55d-1e9860d877d9 req-b8f96ef3-d41d-4d93-8c2c-f2f0eef7ca9d service nova] Acquired lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-d5423887-a8f0-49eb-b55d-1e9860d877d9 req-b8f96ef3-d41d-4d93-8c2c-f2f0eef7ca9d service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Refreshing network info cache for port 2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Start _get_guest_xml network_info=[{"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:41:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1417432124',display_name='tempest-AttachVolumeTestJSON-server-1417432124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1417432124',id=28,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9pEXZ9fcRYxQz9n0tU7qAKxup3/F7Ma4Du+bBxN3a2wuwvGOzZFPTpRVVacPjJQYGm83rAGtm0oKS/dy/uThhQE2gWAolwHWNUzAh7P8vX+cPHHJC38xViW+Ei3k8nKQ==',key_name='tempest-keypair-766777034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-uv1a6r22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=19d13739-5512-48f7-a79c-d5b87fb9cc78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=2482e1e9-0789-46f8-a0c1-db7b0c189d46,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2482e1e9-07') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.objects.instance [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'pci_devices' on Instance uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:41:55 user nova-compute[75215]:   <uuid>19d13739-5512-48f7-a79c-d5b87fb9cc78</uuid>
Nov 11 01:41:55 user nova-compute[75215]:   <name>instance-0000001c</name>
Nov 11 01:41:55 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:41:55 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:41:55 user nova-compute[75215]:   <metadata>
Nov 11 01:41:55 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:41:55 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:41:55 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeTestJSON-server-1417432124</nova:name>
Nov 11 01:41:55 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:41:55</nova:creationTime>
Nov 11 01:41:55 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:41:55 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:41:55 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:41:55 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:41:55 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:41:55 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:41:55 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:41:55 user nova-compute[75215]:       <nova:owner>
Nov 11 01:41:55 user nova-compute[75215]:         <nova:user uuid="285cd483fbdc4e4faec7a1bbd414ca7f">tempest-AttachVolumeTestJSON-1999559004-project-member</nova:user>
Nov 11 01:41:55 user nova-compute[75215]:         <nova:project uuid="f71c4317ced540a1a841f41cb9929b7b">tempest-AttachVolumeTestJSON-1999559004</nova:project>
Nov 11 01:41:55 user nova-compute[75215]:       </nova:owner>
Nov 11 01:41:55 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:41:55 user nova-compute[75215]:       <nova:ports>
Nov 11 01:41:55 user nova-compute[75215]:         <nova:port uuid="2482e1e9-0789-46f8-a0c1-db7b0c189d46">
Nov 11 01:41:55 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 01:41:55 user nova-compute[75215]:         </nova:port>
Nov 11 01:41:55 user nova-compute[75215]:       </nova:ports>
Nov 11 01:41:55 user nova-compute[75215]:     </nova:instance>
Nov 11 01:41:55 user nova-compute[75215]:   </metadata>
Nov 11 01:41:55 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:41:55 user nova-compute[75215]:     <system>
Nov 11 01:41:55 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:41:55 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:41:55 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:41:55 user nova-compute[75215]:       <entry name="serial">19d13739-5512-48f7-a79c-d5b87fb9cc78</entry>
Nov 11 01:41:55 user nova-compute[75215]:       <entry name="uuid">19d13739-5512-48f7-a79c-d5b87fb9cc78</entry>
Nov 11 01:41:55 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:41:55 user nova-compute[75215]:     </system>
Nov 11 01:41:55 user nova-compute[75215]:   </sysinfo>
Nov 11 01:41:55 user nova-compute[75215]:   <os>
Nov 11 01:41:55 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:41:55 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:41:55 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:41:55 user nova-compute[75215]:   </os>
Nov 11 01:41:55 user nova-compute[75215]:   <features>
Nov 11 01:41:55 user nova-compute[75215]:     <acpi/>
Nov 11 01:41:55 user nova-compute[75215]:     <apic/>
Nov 11 01:41:55 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:41:55 user nova-compute[75215]:   </features>
Nov 11 01:41:55 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:41:55 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:41:55 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:41:55 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:41:55 user nova-compute[75215]:   </clock>
Nov 11 01:41:55 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:41:55 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:41:55 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:41:55 user nova-compute[75215]:   </cpu>
Nov 11 01:41:55 user nova-compute[75215]:   <devices>
Nov 11 01:41:55 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:41:55 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:41:55 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk"/>
Nov 11 01:41:55 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:41:55 user nova-compute[75215]:     </disk>
Nov 11 01:41:55 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:41:55 user nova-compute[75215]:       <mac address="fa:16:3e:d8:8e:90"/>
Nov 11 01:41:55 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:41:55 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:41:55 user nova-compute[75215]:       <target dev="tap2482e1e9-07"/>
Nov 11 01:41:55 user nova-compute[75215]:     </interface>
Nov 11 01:41:55 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:41:55 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/console.log" append="off"/>
Nov 11 01:41:55 user nova-compute[75215]:     </serial>
Nov 11 01:41:55 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:41:55 user nova-compute[75215]:     <video>
Nov 11 01:41:55 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:41:55 user nova-compute[75215]:     </video>
Nov 11 01:41:55 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:41:55 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:41:55 user nova-compute[75215]:     </rng>
Nov 11 01:41:55 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:41:55 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:41:55 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:41:55 user nova-compute[75215]:     </memballoon>
Nov 11 01:41:55 user nova-compute[75215]:   </devices>
Nov 11 01:41:55 user nova-compute[75215]: </domain>
Nov 11 01:41:55 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1417432124',display_name='tempest-AttachVolumeTestJSON-server-1417432124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1417432124',id=28,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9pEXZ9fcRYxQz9n0tU7qAKxup3/F7Ma4Du+bBxN3a2wuwvGOzZFPTpRVVacPjJQYGm83rAGtm0oKS/dy/uThhQE2gWAolwHWNUzAh7P8vX+cPHHJC38xViW+Ei3k8nKQ==',key_name='tempest-keypair-766777034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-uv1a6r22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=19d13739-5512-48f7-a79c-d5b87fb9cc78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=2482e1e9-0789-46f8-a0c1-db7b0c189d46,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2482e1e9-07') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG os_vif [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=2482e1e9-0789-46f8-a0c1-db7b0c189d46,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2482e1e9-07') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f17f80df-4967-5dad-8ac5-93613534cdae', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2482e1e9-07, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2482e1e9-07, col_values=(('qos', UUID('99e20ee7-8799-44d0-be8f-a660c275bf1d')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2482e1e9-07, col_values=(('external_ids', {'iface-id': '2482e1e9-0789-46f8-a0c1-db7b0c189d46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:8e:90', 'vm-uuid': '19d13739-5512-48f7-a79c-d5b87fb9cc78'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:55 user nova-compute[75215]: INFO os_vif [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=2482e1e9-0789-46f8-a0c1-db7b0c189d46,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2482e1e9-07')
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No VIF found with MAC fa:16:3e:d8:8e:90, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-d5423887-a8f0-49eb-b55d-1e9860d877d9 req-b8f96ef3-d41d-4d93-8c2c-f2f0eef7ca9d service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updated VIF entry in instance network info cache for port 2482e1e9-0789-46f8-a0c1-db7b0c189d46. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-d5423887-a8f0-49eb-b55d-1e9860d877d9 req-b8f96ef3-d41d-4d93-8c2c-f2f0eef7ca9d service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updating instance_info_cache with network_info: [{"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:41:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d5423887-a8f0-49eb-b55d-1e9860d877d9 req-b8f96ef3-d41d-4d93-8c2c-f2f0eef7ca9d service nova] Releasing lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:41:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-89414539-8a70-4870-ab70-2cb7d588f01f req-15f7e11e-f01c-4aef-ae70-455943014312 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-89414539-8a70-4870-ab70-2cb7d588f01f req-15f7e11e-f01c-4aef-ae70-455943014312 service nova] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-89414539-8a70-4870-ab70-2cb7d588f01f req-15f7e11e-f01c-4aef-ae70-455943014312 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-89414539-8a70-4870-ab70-2cb7d588f01f req-15f7e11e-f01c-4aef-ae70-455943014312 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-89414539-8a70-4870-ab70-2cb7d588f01f req-15f7e11e-f01c-4aef-ae70-455943014312 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] No waiting events found dispatching network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:57 user nova-compute[75215]: WARNING nova.compute.manager [req-89414539-8a70-4870-ab70-2cb7d588f01f req-15f7e11e-f01c-4aef-ae70-455943014312 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received unexpected event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 for instance with vm_state building and task_state spawning.
Nov 11 01:41:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:41:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Instance spawned successfully.
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-3f30957f-521b-4cc8-aaf7-5ee8f8891594 req-f39d57da-30a8-4205-a24e-884754cbda8e service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3f30957f-521b-4cc8-aaf7-5ee8f8891594 req-f39d57da-30a8-4205-a24e-884754cbda8e service nova] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3f30957f-521b-4cc8-aaf7-5ee8f8891594 req-f39d57da-30a8-4205-a24e-884754cbda8e service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3f30957f-521b-4cc8-aaf7-5ee8f8891594 req-f39d57da-30a8-4205-a24e-884754cbda8e service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-3f30957f-521b-4cc8-aaf7-5ee8f8891594 req-f39d57da-30a8-4205-a24e-884754cbda8e service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] No waiting events found dispatching network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:41:59 user nova-compute[75215]: WARNING nova.compute.manager [req-3f30957f-521b-4cc8-aaf7-5ee8f8891594 req-f39d57da-30a8-4205-a24e-884754cbda8e service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received unexpected event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 for instance with vm_state building and task_state spawning.
Nov 11 01:41:59 user nova-compute[75215]: INFO nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:41:59 user nova-compute[75215]: INFO nova.compute.manager [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Took 6.57 seconds to build instance.
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-00e235b6-361a-476d-b36d-48124cec8a1c tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTukDqna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:41:59 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:41:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:41:59 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:41:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:41:59 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b925b474-f7b9-49b3-8a22-2674ac07660f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:41:59 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:41:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4665d47-eb11-4dd6-b8c0-470cf5059cdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f] added
Nov 11 01:42:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d88ac-fbe4-4644-8bc9-5c40e691865a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[983f3530-f05a-4844-8cf9-5a060ae10ad1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTukDqna {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTukDqna" returned: 0 in 0.033s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[45503afb-3609-40e5-8fc0-d45e579d0b88]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GTukDqna'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b182f9d3-2d03-4a8e-877b-5b66b29f3496]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca4448e-cc74-48d7-a247-efbd69a3d59b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f466d-bdd2-4e59-8646-27a8c1888dea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f, portal: 172.16.0.220,3260]
Nov 11 01:42:00 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f, portal: 172.16.0.220,3260] successful.
Nov 11 01:42:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ee386-36e1-4b13-8092-970ff87b41d7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d85f2-a6e7-44f5-a16f-93087acc7de8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:00 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:00 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:42:00 user nova-compute[75215]: INFO nova.compute.manager [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Terminating instance
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.043s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077636f-5ed4-4fe0-a19d-be222c778111]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTukDqna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Instance destroyed successfully.
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lazy-loading 'resources' on Instance uuid d48231dc-e985-40ec-a122-fa4a24618e8d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1492560123',display_name='tempest-VolumesActionsTest-instance-1492560123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1492560123',id=23,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28351ac5c20f4fa0be12a86bd5cd5ce9',ramdisk_id='',reservation_id='r-v9h0lmlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-979308973',owner_user_name='tempest-VolumesActionsTest-979308973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:07Z,user_data=None,user_id='ec2a1a4aed354d499952775c177f376f',uuid=d48231dc-e985-40ec-a122-fa4a24618e8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converting VIF {"id": "8780765c-2b58-4252-8dcf-76ad64824854", "address": "fa:16:3e:ae:b9:71", "network": {"id": "080c3c60-6c52-4384-9fc3-e182fc3da3bf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-362748651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28351ac5c20f4fa0be12a86bd5cd5ce9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8780765c-2b", "ovs_interfaceid": "8780765c-2b58-4252-8dcf-76ad64824854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b9:71,bridge_name='br-int',has_traffic_filtering=True,id=8780765c-2b58-4252-8dcf-76ad64824854,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8780765c-2b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG os_vif [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b9:71,bridge_name='br-int',has_traffic_filtering=True,id=8780765c-2b58-4252-8dcf-76ad64824854,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8780765c-2b') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8780765c-2b, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8af3a276-5b0e-4eb8-ae95-8eec8120301d) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: INFO os_vif [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b9:71,bridge_name='br-int',has_traffic_filtering=True,id=8780765c-2b58-4252-8dcf-76ad64824854,network=Network(080c3c60-6c52-4384-9fc3-e182fc3da3bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8780765c-2b')
Nov 11 01:42:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Deleting instance files /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d_del
Nov 11 01:42:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Deletion of /opt/stack/data/nova/instances/d48231dc-e985-40ec-a122-fa4a24618e8d_del complete
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: INFO nova.compute.manager [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26336653331643539', 'path': '/dev/sdf'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336653331643539', 'path': '/dev/sdf'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid d207b4de-98f2-41ce-ba8f-af7583b6bb76 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-unplugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] No waiting events found dispatching network-vif-unplugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-unplugged-8780765c-2b58-4252-8dcf-76ad64824854 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] No waiting events found dispatching network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:01 user nova-compute[75215]: WARNING nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received unexpected event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 for instance with vm_state active and task_state deleting.
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] No waiting events found dispatching network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:01 user nova-compute[75215]: WARNING nova.compute.manager [req-1915bbc1-36d5-46a2-87cb-af16532e6ec7 req-212999c5-a655-44a2-adef-05e9ebe7f1db service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received unexpected event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 for instance with vm_state active and task_state deleting.
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:42:01 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:42:01 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:42:01 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:42:01 user nova-compute[75215]:   <serial>7942f82a-eb3a-43e7-8d67-3f2f1636dc8f</serial>
Nov 11 01:42:01 user nova-compute[75215]: </disk>
Nov 11 01:42:01 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No VIF found with MAC fa:16:3e:56:3e:4d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:42:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-069d2827-a520-49d9-854d-bf9ec96a0603 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.878s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:02 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:42:02 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Took 1.09 seconds to deallocate network for instance.
Nov 11 01:42:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:03 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Deleted allocations for instance d48231dc-e985-40ec-a122-fa4a24618e8d
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-4a5bdb0c-c28f-4625-b820-76d18965e95b tempest-VolumesActionsTest-979308973 tempest-VolumesActionsTest-979308973-project-member] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] No waiting events found dispatching network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:03 user nova-compute[75215]: WARNING nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received unexpected event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 for instance with vm_state deleted and task_state None.
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-unplugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] No waiting events found dispatching network-vif-unplugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:03 user nova-compute[75215]: WARNING nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received unexpected event network-vif-unplugged-8780765c-2b58-4252-8dcf-76ad64824854 for instance with vm_state deleted and task_state None.
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-deleted-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Acquiring lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] Lock "d48231dc-e985-40ec-a122-fa4a24618e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] No waiting events found dispatching network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:03 user nova-compute[75215]: WARNING nova.compute.manager [req-55816612-7ff7-437e-8fcc-2b0cf75c6fcc req-b3f0eeed-20f8-4db2-a804-a5edb74e8cff service nova] [instance: d48231dc-e985-40ec-a122-fa4a24618e8d] Received unexpected event network-vif-plugged-8780765c-2b58-4252-8dcf-76ad64824854 for instance with vm_state deleted and task_state None.
Nov 11 01:42:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-3029235c-30bb-4d95-bc86-b631b082869b req-d925923b-3272-4434-a4eb-38c423b20f3f service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-changed-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-3029235c-30bb-4d95-bc86-b631b082869b req-d925923b-3272-4434-a4eb-38c423b20f3f service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing instance network info cache due to event network-changed-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:42:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3029235c-30bb-4d95-bc86-b631b082869b req-d925923b-3272-4434-a4eb-38c423b20f3f service nova] Acquiring lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:42:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3029235c-30bb-4d95-bc86-b631b082869b req-d925923b-3272-4434-a4eb-38c423b20f3f service nova] Acquired lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:42:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-3029235c-30bb-4d95-bc86-b631b082869b req-d925923b-3272-4434-a4eb-38c423b20f3f service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Refreshing network info cache for port a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:42:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-3029235c-30bb-4d95-bc86-b631b082869b req-d925923b-3272-4434-a4eb-38c423b20f3f service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updated VIF entry in instance network info cache for port a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:42:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-3029235c-30bb-4d95-bc86-b631b082869b req-d925923b-3272-4434-a4eb-38c423b20f3f service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [{"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:42:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3029235c-30bb-4d95-bc86-b631b082869b req-d925923b-3272-4434-a4eb-38c423b20f3f service nova] Releasing lock "refresh_cache-e6560dd5-4f17-417d-bb0c-269e0284207d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:42:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:07 user nova-compute[75215]: INFO nova.compute.manager [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Terminating instance
Nov 11 01:42:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:42:07 user nova-compute[75215]: INFO nova.compute.claims [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Claim successful on node user
Nov 11 01:42:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-fad241c1-ae7e-4b19-81ca-323d8de9a019 req-371fa4af-1e51-4c12-9e75-5011694dc42a service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fad241c1-ae7e-4b19-81ca-323d8de9a019 req-371fa4af-1e51-4c12-9e75-5011694dc42a service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fad241c1-ae7e-4b19-81ca-323d8de9a019 req-371fa4af-1e51-4c12-9e75-5011694dc42a service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fad241c1-ae7e-4b19-81ca-323d8de9a019 req-371fa4af-1e51-4c12-9e75-5011694dc42a service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-fad241c1-ae7e-4b19-81ca-323d8de9a019 req-371fa4af-1e51-4c12-9e75-5011694dc42a service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-unplugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-fad241c1-ae7e-4b19-81ca-323d8de9a019 req-371fa4af-1e51-4c12-9e75-5011694dc42a service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-515f6d87-ac3e-4f0a-a9c4-0be0f4c48e91 req-16f00d1c-6d7d-45b9-9cc5-be244d7797ab service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-515f6d87-ac3e-4f0a-a9c4-0be0f4c48e91 req-16f00d1c-6d7d-45b9-9cc5-be244d7797ab service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-515f6d87-ac3e-4f0a-a9c4-0be0f4c48e91 req-16f00d1c-6d7d-45b9-9cc5-be244d7797ab service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-515f6d87-ac3e-4f0a-a9c4-0be0f4c48e91 req-16f00d1c-6d7d-45b9-9cc5-be244d7797ab service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-515f6d87-ac3e-4f0a-a9c4-0be0f4c48e91 req-16f00d1c-6d7d-45b9-9cc5-be244d7797ab service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-unplugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-515f6d87-ac3e-4f0a-a9c4-0be0f4c48e91 req-16f00d1c-6d7d-45b9-9cc5-be244d7797ab service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-870da80f-02ea-4b9d-bf3a-11772a73bfcf req-c365c9ae-4bf7-49d3-8011-e8a5639536e7 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-870da80f-02ea-4b9d-bf3a-11772a73bfcf req-c365c9ae-4bf7-49d3-8011-e8a5639536e7 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-870da80f-02ea-4b9d-bf3a-11772a73bfcf req-c365c9ae-4bf7-49d3-8011-e8a5639536e7 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-870da80f-02ea-4b9d-bf3a-11772a73bfcf req-c365c9ae-4bf7-49d3-8011-e8a5639536e7 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-870da80f-02ea-4b9d-bf3a-11772a73bfcf req-c365c9ae-4bf7-49d3-8011-e8a5639536e7 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-unplugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-870da80f-02ea-4b9d-bf3a-11772a73bfcf req-c365c9ae-4bf7-49d3-8011-e8a5639536e7 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.071s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:42:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:42:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:42:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.policy [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da821cfc028b48f6864c064b2ea97c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792836033673405bb7375a08ddc89e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:42:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Creating image(s)
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "/opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "/opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "/opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.259s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Instance destroyed successfully.
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lazy-loading 'resources' on Instance uuid e6560dd5-4f17-417d-bb0c-269e0284207d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:38:28,bridge_name='br-int',has_traffic_filtering=True,id=a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8,network=Network(e68cc7c3-8919-40ce-9094-eb1335a399ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c38c23-70') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:38:28,bridge_name='br-int',has_traffic_filtering=True,id=a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8,network=Network(e68cc7c3-8919-40ce-9094-eb1335a399ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c38c23-70') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6c38c23-70, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.275s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2416f88-279a-48a1-8073-81668bd1b8d7) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk 1073741824" returned: 0 in 0.074s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: INFO os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:38:28,bridge_name='br-int',has_traffic_filtering=True,id=a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8,network=Network(e68cc7c3-8919-40ce-9094-eb1335a399ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6c38c23-70')
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c1:d1,bridge_name='br-int',has_traffic_filtering=True,id=0fa80abb-2866-47dd-b1cb-4189d05d05c1,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0fa80abb-28') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c1:d1,bridge_name='br-int',has_traffic_filtering=True,id=0fa80abb-2866-47dd-b1cb-4189d05d05c1,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0fa80abb-28') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fa80abb-28, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e141b3cb-42b2-4c78-98ad-cc293d75bd58) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: INFO os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c1:d1,bridge_name='br-int',has_traffic_filtering=True,id=0fa80abb-2866-47dd-b1cb-4189d05d05c1,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0fa80abb-28')
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=e4bac6a4-a934-4780-9e9e-d17626b43ba9,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4bac6a4-a9') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=e4bac6a4-a934-4780-9e9e-d17626b43ba9,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4bac6a4-a9') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4bac6a4-a9, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.257s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59050b82-c7fd-4cb5-9cfd-f23e1f8f9ea5) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 for instance with vm_state active and task_state deleting.
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-unplugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d for instance with vm_state active and task_state deleting.
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-unplugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-83e59e94-7503-4236-b69f-c1b289c3f4a0 for instance with vm_state active and task_state deleting.
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-unplugged-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-58ba476f-668b-445a-b5f0-98e63a1d665f for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING nova.compute.manager [req-59db5b57-2e95-42dd-9619-28f027ff1474 req-d12a7260-bae2-4584-bc42-0a5c923fa814 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-58ba476f-668b-445a-b5f0-98e63a1d665f for instance with vm_state active and task_state deleting.
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Successfully created port: 4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:10 user nova-compute[75215]: INFO os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=e4bac6a4-a934-4780-9e9e-d17626b43ba9,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4bac6a4-a9')
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:70:28,bridge_name='br-int',has_traffic_filtering=True,id=c9cd4ac9-bf2f-4ab5-b656-2b886152f79d,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9cd4ac9-bf') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:70:28,bridge_name='br-int',has_traffic_filtering=True,id=c9cd4ac9-bf2f-4ab5-b656-2b886152f79d,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9cd4ac9-bf') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9cd4ac9-bf, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74ac2feb-0cf4-4052-9244-1da748626d31) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-0fa80abb-2866-47dd-b1cb-4189d05d05c1 for instance with vm_state active and task_state deleting.
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-unplugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-unplugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING nova.compute.manager [req-23b093a7-f77f-40f5-a50b-e9ec122aac3a req-343f3cca-8518-4ce9-8a92-ff25fa4c7321 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-e4bac6a4-a934-4780-9e9e-d17626b43ba9 for instance with vm_state active and task_state deleting.
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Cannot resize image /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Ensure instance console log exists: /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: INFO os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:70:28,bridge_name='br-int',has_traffic_filtering=True,id=c9cd4ac9-bf2f-4ab5-b656-2b886152f79d,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9cd4ac9-bf')
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "address": "fa:16:3e:75:a2:86", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166c0c2-1f", "ovs_interfaceid": "2166c0c2-1f64-4b1f-a947-6e269e5d682a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=2166c0c2-1f64-4b1f-a947-6e269e5d682a,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166c0c2-1f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=2166c0c2-1f64-4b1f-a947-6e269e5d682a,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166c0c2-1f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2166c0c2-1f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f60e641-f1da-4dab-b7ef-29cf730773c2) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: INFO os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=2166c0c2-1f64-4b1f-a947-6e269e5d682a,network=Network(dc5eb9cf-a584-429c-affb-4fec1802985f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166c0c2-1f')
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=83e59e94-7503-4236-b69f-c1b289c3f4a0,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e59e94-75') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=83e59e94-7503-4236-b69f-c1b289c3f4a0,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e59e94-75') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83e59e94-75, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f85bb599-20b4-4114-af4c-9a1c97410a43) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: INFO os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=83e59e94-7503-4236-b69f-c1b289c3f4a0,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e59e94-75')
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T01:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1633668785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1633668785',id=19,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2FaUTharsQ5k4a+gq9y/GCJpLNy5c5wxSVjFI8uD/FmuiMz5aFXNo+pVnI5S8fXVZBlsuwBgYrA7wgPk92EwZ6QPW9PzoHlSacoIg1KUSLwfzcjWARXp6BPd2mHad3bg==',key_name='tempest-keypair-1045466653',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc975a9ec00422abc485cd279c4aa57',ramdisk_id='',reservation_id='r-7mdwscob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-811690612',owner_user_name='tempest-TaggedBootDevicesTest_v242-811690612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931b9fe1dbdb4a9ebf7419627df1e6d0',uuid=e6560dd5-4f17-417d-bb0c-269e0284207d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converting VIF {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:45,bridge_name='br-int',has_traffic_filtering=True,id=58ba476f-668b-445a-b5f0-98e63a1d665f,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ba476f-66') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:45,bridge_name='br-int',has_traffic_filtering=True,id=58ba476f-668b-445a-b5f0-98e63a1d665f,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ba476f-66') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58ba476f-66, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98393173-c4bc-45dd-b93f-be0f3531b81c) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:10 user nova-compute[75215]: INFO os_vif [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:45,bridge_name='br-int',has_traffic_filtering=True,id=58ba476f-668b-445a-b5f0-98e63a1d665f,network=Network(2d994fa9-b0c5-47e8-a05e-51a22c968f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ba476f-66')
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXmWTjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba97dc-bb10-4bc1-8fb3-2d9907882c1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:42:10 user nova-compute[75215]: No targets found.
Nov 11 01:42:10 user nova-compute[75215]: iSNS:
Nov 11 01:42:10 user nova-compute[75215]: No targets found.
Nov 11 01:42:10 user nova-compute[75215]: STATIC:
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: FIRMWARE:
Nov 11 01:42:10 user nova-compute[75215]: No targets found.
Nov 11 01:42:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:42:10 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:42:10 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc07af7a-28e5-4204-8983-41e428a4c147]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d66a65-225d-4681-b6ee-9e3b23ac9136]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4044253e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0e1f6-d7c2-4301-b549-3d7c98e40925]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa59130-16d1-44c3-864c-bde770831739]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d266424-505c-4689-9bd4-d349af73d143]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d75a0a3-c5e9-48f8-bbe9-fa314f928e60 req-6ea6dcd3-6de6-4775-a2d2-134874ce435a service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d75a0a3-c5e9-48f8-bbe9-fa314f928e60 req-6ea6dcd3-6de6-4775-a2d2-134874ce435a service nova] Acquiring lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d75a0a3-c5e9-48f8-bbe9-fa314f928e60 req-6ea6dcd3-6de6-4775-a2d2-134874ce435a service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1d75a0a3-c5e9-48f8-bbe9-fa314f928e60 req-6ea6dcd3-6de6-4775-a2d2-134874ce435a service nova] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-1d75a0a3-c5e9-48f8-bbe9-fa314f928e60 req-6ea6dcd3-6de6-4775-a2d2-134874ce435a service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] No waiting events found dispatching network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING nova.compute.manager [req-1d75a0a3-c5e9-48f8-bbe9-fa314f928e60 req-6ea6dcd3-6de6-4775-a2d2-134874ce435a service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received unexpected event network-vif-plugged-2166c0c2-1f64-4b1f-a947-6e269e5d682a for instance with vm_state active and task_state deleting.
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.073s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d791ac1-41ec-4d0c-a94a-b49393e36dd5]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9e0d1-446e-40a2-b197-33decdc0e957]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f18b753-3ca3-4f87-be41-30e970063957]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4, portal: 172.16.0.220,3260]
Nov 11 01:42:10 user nova-compute[75215]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4, portal: 172.16.0.220,3260] successful.
Nov 11 01:42:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Successfully updated port: 4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:163ae624-3d5a-43ba-af71-dd8c20b00de4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd669274-904e-450c-ae87-bae5cfbc619b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== disconnect_volume: return (441ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMxqFSBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:42:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquired lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac22ead6-095a-44dc-80a9-2c5665b060c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:42:10 user nova-compute[75215]: No targets found.
Nov 11 01:42:10 user nova-compute[75215]: iSNS:
Nov 11 01:42:10 user nova-compute[75215]: No targets found.
Nov 11 01:42:10 user nova-compute[75215]: STATIC:
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64
Nov 11 01:42:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:10 user nova-compute[75215]: FIRMWARE:
Nov 11 01:42:10 user nova-compute[75215]: No targets found.
Nov 11 01:42:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:42:10 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:42:10 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[731be262-772c-41fa-bd4a-9f0952fc2955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9c3fcd-83ad-4e74-9460-62b5645975a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:10 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404435e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6139a7c0-3bd4-4732-a251-5576dc447106]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad23058-bbc4-44af-b035-3758ef6ef34f]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59ad6e7-061b-453d-ac4a-7f6ebd5b23f5]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:42:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a879d9a1-43a5-4eec-934d-5a8af6ab890a]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4647a0c9-f0c4-4069-9d0f-8ed71046b2c4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d4ace2-81a3-4f46-bb97-50cf28e5ad83]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e, portal: 172.16.0.220,3260]
Nov 11 01:42:11 user nova-compute[75215]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e, portal: 172.16.0.220,3260] successful.
Nov 11 01:42:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Updating instance_info_cache with network_info: [{"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Releasing lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Instance network_info: |[{"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9070f744-84b7-47eb-a525-c7b150fa166e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b2d10d-7922-435e-89c7-db1adeaeadb4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Start _get_guest_xml network_info=[{"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== disconnect_volume: return (347ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQxdkMwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:42:11 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:42:11 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-520088867',display_name='tempest-AttachVolumeNegativeTest-server-520088867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-520088867',id=29,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdOj4gakdXMZ4TFiXY6uyRoO1RJG8Ldg5zEm7Im72HlwRhdxbGuPmJhGWpIKwAlGO2px7JBYHEPg4PpHrkItXaytNMnaJ7Am6+oFYLru4c8F5SAU9i833F6FQXOPZVfnw==',key_name='tempest-keypair-1527861399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-mvuj0qmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=43a0ee0f-c3ce-438d-84be-e9eaf19f5e37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b6:44,bridge_name='br-int',has_traffic_filtering=True,id=4c773def-22ad-458a-8eb1-6f3b86e495f0,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c773def-22') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'pci_devices' on Instance uuid 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d704f6-6eb0-48d0-a1de-7e12c1414ba7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:42:11 user nova-compute[75215]: No targets found.
Nov 11 01:42:11 user nova-compute[75215]: iSNS:
Nov 11 01:42:11 user nova-compute[75215]: No targets found.
Nov 11 01:42:11 user nova-compute[75215]: STATIC:
Nov 11 01:42:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f
Nov 11 01:42:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad
Nov 11 01:42:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:42:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64
Nov 11 01:42:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:42:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:42:11 user nova-compute[75215]: FIRMWARE:
Nov 11 01:42:11 user nova-compute[75215]: No targets found.
Nov 11 01:42:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:42:11 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:42:11 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:42:11 user nova-compute[75215]:   <uuid>43a0ee0f-c3ce-438d-84be-e9eaf19f5e37</uuid>
Nov 11 01:42:11 user nova-compute[75215]:   <name>instance-0000001d</name>
Nov 11 01:42:11 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:42:11 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:42:11 user nova-compute[75215]:   <metadata>
Nov 11 01:42:11 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:42:11 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:42:11 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeNegativeTest-server-520088867</nova:name>
Nov 11 01:42:11 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:42:11</nova:creationTime>
Nov 11 01:42:11 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:42:11 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:42:11 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:42:11 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:42:11 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:42:11 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:42:11 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:42:11 user nova-compute[75215]:       <nova:owner>
Nov 11 01:42:11 user nova-compute[75215]:         <nova:user uuid="da821cfc028b48f6864c064b2ea97c02">tempest-AttachVolumeNegativeTest-791087113-project-member</nova:user>
Nov 11 01:42:11 user nova-compute[75215]:         <nova:project uuid="792836033673405bb7375a08ddc89e18">tempest-AttachVolumeNegativeTest-791087113</nova:project>
Nov 11 01:42:11 user nova-compute[75215]:       </nova:owner>
Nov 11 01:42:11 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:42:11 user nova-compute[75215]:       <nova:ports>
Nov 11 01:42:11 user nova-compute[75215]:         <nova:port uuid="4c773def-22ad-458a-8eb1-6f3b86e495f0">
Nov 11 01:42:11 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:42:11 user nova-compute[75215]:         </nova:port>
Nov 11 01:42:11 user nova-compute[75215]:       </nova:ports>
Nov 11 01:42:11 user nova-compute[75215]:     </nova:instance>
Nov 11 01:42:11 user nova-compute[75215]:   </metadata>
Nov 11 01:42:11 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:42:11 user nova-compute[75215]:     <system>
Nov 11 01:42:11 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:42:11 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:42:11 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:42:11 user nova-compute[75215]:       <entry name="serial">43a0ee0f-c3ce-438d-84be-e9eaf19f5e37</entry>
Nov 11 01:42:11 user nova-compute[75215]:       <entry name="uuid">43a0ee0f-c3ce-438d-84be-e9eaf19f5e37</entry>
Nov 11 01:42:11 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:42:11 user nova-compute[75215]:     </system>
Nov 11 01:42:11 user nova-compute[75215]:   </sysinfo>
Nov 11 01:42:11 user nova-compute[75215]:   <os>
Nov 11 01:42:11 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:42:11 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:42:11 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:42:11 user nova-compute[75215]:   </os>
Nov 11 01:42:11 user nova-compute[75215]:   <features>
Nov 11 01:42:11 user nova-compute[75215]:     <acpi/>
Nov 11 01:42:11 user nova-compute[75215]:     <apic/>
Nov 11 01:42:11 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:42:11 user nova-compute[75215]:   </features>
Nov 11 01:42:11 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:42:11 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:42:11 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:42:11 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:42:11 user nova-compute[75215]:   </clock>
Nov 11 01:42:11 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:42:11 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:42:11 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:42:11 user nova-compute[75215]:   </cpu>
Nov 11 01:42:11 user nova-compute[75215]:   <devices>
Nov 11 01:42:11 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:42:11 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:42:11 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk"/>
Nov 11 01:42:11 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:42:11 user nova-compute[75215]:     </disk>
Nov 11 01:42:11 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:42:11 user nova-compute[75215]:       <mac address="fa:16:3e:28:b6:44"/>
Nov 11 01:42:11 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:42:11 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:42:11 user nova-compute[75215]:       <target dev="tap4c773def-22"/>
Nov 11 01:42:11 user nova-compute[75215]:     </interface>
Nov 11 01:42:11 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:42:11 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/console.log" append="off"/>
Nov 11 01:42:11 user nova-compute[75215]:     </serial>
Nov 11 01:42:11 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:42:11 user nova-compute[75215]:     <video>
Nov 11 01:42:11 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:42:11 user nova-compute[75215]:     </video>
Nov 11 01:42:11 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:42:11 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:42:11 user nova-compute[75215]:     </rng>
Nov 11 01:42:11 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:42:11 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:42:11 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:42:11 user nova-compute[75215]:     </memballoon>
Nov 11 01:42:11 user nova-compute[75215]:   </devices>
Nov 11 01:42:11 user nova-compute[75215]: </domain>
Nov 11 01:42:11 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-520088867',display_name='tempest-AttachVolumeNegativeTest-server-520088867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-520088867',id=29,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdOj4gakdXMZ4TFiXY6uyRoO1RJG8Ldg5zEm7Im72HlwRhdxbGuPmJhGWpIKwAlGO2px7JBYHEPg4PpHrkItXaytNMnaJ7Am6+oFYLru4c8F5SAU9i833F6FQXOPZVfnw==',key_name='tempest-keypair-1527861399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-mvuj0qmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=43a0ee0f-c3ce-438d-84be-e9eaf19f5e37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b6:44,bridge_name='br-int',has_traffic_filtering=True,id=4c773def-22ad-458a-8eb1-6f3b86e495f0,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c773def-22') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_vif [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b6:44,bridge_name='br-int',has_traffic_filtering=True,id=4c773def-22ad-458a-8eb1-6f3b86e495f0,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c773def-22') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbd0a4cf-0973-5a87-b40c-09c23d0187d7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a547bf-254e-4cbb-a134-72b6be1470a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c773def-22, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c773def-22, col_values=(('qos', UUID('2873aa0a-e574-41b7-9c78-862a5a6978e3')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c773def-22, col_values=(('external_ids', {'iface-id': '4c773def-22ad-458a-8eb1-6f3b86e495f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:b6:44', 'vm-uuid': '43a0ee0f-c3ce-438d-84be-e9eaf19f5e37'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:11 user nova-compute[75215]: INFO os_vif [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b6:44,bridge_name='br-int',has_traffic_filtering=True,id=4c773def-22ad-458a-8eb1-6f3b86e495f0,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c773def-22')
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896ebb2-359e-455c-bb86-38d891ebae87]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:11 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:11 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:11 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:11 user nova-compute[75215]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 (non-flash)
Nov 11 01:42:11 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:11 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404435fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3744b9-e9db-4ff6-b759-75c168554785]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[942c8938-36a6-4221-886c-cf1670ddaac8]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No VIF found with MAC fa:16:3e:28:b6:44, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6da676-6dba-47e2-9161-8b5a82d07c8b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c648bfa8-b5a0-4a02-9bd5-757621148ce4]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d915380c-c94f-4efd-94c6-91ef1e68e678]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ab5887-6bf6-4aa5-9651-0da3fe793086]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64, portal: 172.16.0.220,3260]
Nov 11 01:42:11 user nova-compute[75215]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64, portal: 172.16.0.220,3260] successful.
Nov 11 01:42:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c959653d-65b1-4472-84e0-a072a8a07c64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e70507a-4b98-40b4-b930-905d5bf65302]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] <== disconnect_volume: return (362ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:42:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Deleting instance files /opt/stack/data/nova/instances/e6560dd5-4f17-417d-bb0c-269e0284207d_del
Nov 11 01:42:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Deletion of /opt/stack/data/nova/instances/e6560dd5-4f17-417d-bb0c-269e0284207d_del complete
Nov 11 01:42:11 user nova-compute[75215]: INFO nova.compute.manager [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Took 4.08 seconds to destroy the instance on the hypervisor.
Nov 11 01:42:11 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:42:11 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:42:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-d6a9fe5b-32b6-4884-b4f0-bfbeb24196ac req-fcaedb31-f057-4f8a-a8fc-184532a20162 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received event network-changed-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-d6a9fe5b-32b6-4884-b4f0-bfbeb24196ac req-fcaedb31-f057-4f8a-a8fc-184532a20162 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Refreshing instance network info cache due to event network-changed-4c773def-22ad-458a-8eb1-6f3b86e495f0. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:42:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d6a9fe5b-32b6-4884-b4f0-bfbeb24196ac req-fcaedb31-f057-4f8a-a8fc-184532a20162 service nova] Acquiring lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:42:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d6a9fe5b-32b6-4884-b4f0-bfbeb24196ac req-fcaedb31-f057-4f8a-a8fc-184532a20162 service nova] Acquired lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:42:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-d6a9fe5b-32b6-4884-b4f0-bfbeb24196ac req-fcaedb31-f057-4f8a-a8fc-184532a20162 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Refreshing network info cache for port 4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:42:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-ec5753a8-672f-4c91-ab6d-1e5fea0649d8 req-b764d4cd-d614-4cdc-ab03-a46c9a984574 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received event network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ec5753a8-672f-4c91-ab6d-1e5fea0649d8 req-b764d4cd-d614-4cdc-ab03-a46c9a984574 service nova] Acquiring lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ec5753a8-672f-4c91-ab6d-1e5fea0649d8 req-b764d4cd-d614-4cdc-ab03-a46c9a984574 service nova] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ec5753a8-672f-4c91-ab6d-1e5fea0649d8 req-b764d4cd-d614-4cdc-ab03-a46c9a984574 service nova] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-ec5753a8-672f-4c91-ab6d-1e5fea0649d8 req-b764d4cd-d614-4cdc-ab03-a46c9a984574 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] No waiting events found dispatching network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:13 user nova-compute[75215]: WARNING nova.compute.manager [req-ec5753a8-672f-4c91-ab6d-1e5fea0649d8 req-b764d4cd-d614-4cdc-ab03-a46c9a984574 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received unexpected event network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 for instance with vm_state building and task_state spawning.
Nov 11 01:42:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-d6a9fe5b-32b6-4884-b4f0-bfbeb24196ac req-fcaedb31-f057-4f8a-a8fc-184532a20162 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Updated VIF entry in instance network info cache for port 4c773def-22ad-458a-8eb1-6f3b86e495f0. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-d6a9fe5b-32b6-4884-b4f0-bfbeb24196ac req-fcaedb31-f057-4f8a-a8fc-184532a20162 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Updating instance_info_cache with network_info: [{"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:42:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d6a9fe5b-32b6-4884-b4f0-bfbeb24196ac req-fcaedb31-f057-4f8a-a8fc-184532a20162 service nova] Releasing lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:42:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-842ec822-dc53-4f02-ab25-ce4ff7355857 req-0e63cbef-5c9e-43ef-8c80-02bb43cc7003 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-deleted-2166c0c2-1f64-4b1f-a947-6e269e5d682a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:14 user nova-compute[75215]: INFO nova.compute.manager [req-842ec822-dc53-4f02-ab25-ce4ff7355857 req-0e63cbef-5c9e-43ef-8c80-02bb43cc7003 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Neutron deleted interface 2166c0c2-1f64-4b1f-a947-6e269e5d682a; detaching it from the instance and deleting it from the info cache
Nov 11 01:42:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-842ec822-dc53-4f02-ab25-ce4ff7355857 req-0e63cbef-5c9e-43ef-8c80-02bb43cc7003 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [{"id": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "address": "fa:16:3e:69:38:28", "network": {"id": "e68cc7c3-8919-40ce-9094-eb1335a399ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1917866452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6c38c23-70", "ovs_interfaceid": "a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "address": "fa:16:3e:bd:c1:d1", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa80abb-28", "ovs_interfaceid": "0fa80abb-2866-47dd-b1cb-4189d05d05c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "address": "fa:16:3e:18:21:3b", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4bac6a4-a9", "ovs_interfaceid": "e4bac6a4-a934-4780-9e9e-d17626b43ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "address": "fa:16:3e:b4:70:28", "network": {"id": "dc5eb9cf-a584-429c-affb-4fec1802985f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1282664076", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9cd4ac9-bf", "ovs_interfaceid": "c9cd4ac9-bf2f-4ab5-b656-2b886152f79d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "address": "fa:16:3e:7d:da:dc", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e59e94-75", "ovs_interfaceid": "83e59e94-7503-4236-b69f-c1b289c3f4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58ba476f-668b-445a-b5f0-98e63a1d665f", "address": "fa:16:3e:3d:19:45", "network": {"id": "2d994fa9-b0c5-47e8-a05e-51a22c968f57", "bridge": "br-int", "label": "tempest-device-tagging-net2-122537520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc975a9ec00422abc485cd279c4aa57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ba476f-66", "ovs_interfaceid": "58ba476f-668b-445a-b5f0-98e63a1d665f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:42:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-842ec822-dc53-4f02-ab25-ce4ff7355857 req-0e63cbef-5c9e-43ef-8c80-02bb43cc7003 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Detach interface failed, port_id=2166c0c2-1f64-4b1f-a947-6e269e5d682a, reason: Instance e6560dd5-4f17-417d-bb0c-269e0284207d could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:42:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Creating image(s)
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Ensure instance console log exists: /opt/stack/data/nova/instances/298c4f12-029f-407a-a71f-d5c722655f8d/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Start _get_guest_xml network_info=[{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '3ca14d12-d83a-4b69-a47b-185399db420b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGOIeEap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '298c4f12-029f-407a-a71f-d5c722655f8d', 'attached_at': '', 'detached_at': '', 'volume_id': '42983526-ca9e-4973-8891-7830b5f2fc1e', 'serial': '42983526-ca9e-4973-8891-7830b5f2fc1e'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-2b5ffb90-0218-46b5-9f12-36fffc34a6e6 req-fc0319aa-7c34-4c6e-85bd-a81579bf536a service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received event network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2b5ffb90-0218-46b5-9f12-36fffc34a6e6 req-fc0319aa-7c34-4c6e-85bd-a81579bf536a service nova] Acquiring lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2b5ffb90-0218-46b5-9f12-36fffc34a6e6 req-fc0319aa-7c34-4c6e-85bd-a81579bf536a service nova] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2b5ffb90-0218-46b5-9f12-36fffc34a6e6 req-fc0319aa-7c34-4c6e-85bd-a81579bf536a service nova] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-2b5ffb90-0218-46b5-9f12-36fffc34a6e6 req-fc0319aa-7c34-4c6e-85bd-a81579bf536a service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] No waiting events found dispatching network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:15 user nova-compute[75215]: WARNING nova.compute.manager [req-2b5ffb90-0218-46b5-9f12-36fffc34a6e6 req-fc0319aa-7c34-4c6e-85bd-a81579bf536a service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received unexpected event network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 for instance with vm_state building and task_state spawning.
Nov 11 01:42:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:42:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGOIeEap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:42:15 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:42:15 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:42:15 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:42:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Instance spawned successfully.
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e2616-50c5-4f69-9d7a-788a4a46f724]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:42:15 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85fa9fa-9e22-4446-a99f-ede906b97d21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e] added
Nov 11 01:42:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d712cf-2a04-4c5f-b995-edb61a922c20]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3171f6b-f4b4-4642-8837-4fe6568ef3b5]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGOIeEap {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGOIeEap" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f77610-e736-44ef-bfc7-af3ae1af14c1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TGOIeEap'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: INFO nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 11 01:42:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb835df-4308-4230-b2e5-2c22cbd61590]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[98435b26-9513-483c-8435-7993e86774a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: INFO nova.compute.manager [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Took 7.86 seconds to build instance.
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5f7284e9-5efc-4b18-b733-5224b5729545 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.009s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b90d1a-c62b-43af-b363-dffbf182f080]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260]
Nov 11 01:42:15 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260] successful.
Nov 11 01:42:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b764dc-063c-4fff-856d-98f9255cbc54]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e0a9ff-0777-4426-b16e-13473969abb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:42:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:42:15 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:42:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6d5682-98c7-414e-a5d9-e949cc490c2a]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:42:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGOIeEap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:42:16 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Took 4.62 seconds to deallocate network for instance.
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26338323931383036', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338323931383036', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538928176',display_name='tempest-ServerActionsTestOtherA-server-538928176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538928176',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-tlmg4me0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=298c4f12-029f-407a-a71f-d5c722655f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.objects.instance [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'pci_devices' on Instance uuid 298c4f12-029f-407a-a71f-d5c722655f8d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:42:16 user nova-compute[75215]:   <uuid>298c4f12-029f-407a-a71f-d5c722655f8d</uuid>
Nov 11 01:42:16 user nova-compute[75215]:   <name>instance-0000001a</name>
Nov 11 01:42:16 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:42:16 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:42:16 user nova-compute[75215]:   <metadata>
Nov 11 01:42:16 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:42:16 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:42:16 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherA-server-538928176</nova:name>
Nov 11 01:42:16 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:42:15</nova:creationTime>
Nov 11 01:42:16 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:42:16 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:42:16 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:42:16 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:42:16 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:42:16 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:42:16 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:42:16 user nova-compute[75215]:       <nova:owner>
Nov 11 01:42:16 user nova-compute[75215]:         <nova:user uuid="44e25bace5db43638b4eedfeb9215e24">tempest-ServerActionsTestOtherA-802983068-project-member</nova:user>
Nov 11 01:42:16 user nova-compute[75215]:         <nova:project uuid="c6fb80bd889f488bbfa25060dca25bb8">tempest-ServerActionsTestOtherA-802983068</nova:project>
Nov 11 01:42:16 user nova-compute[75215]:       </nova:owner>
Nov 11 01:42:16 user nova-compute[75215]:       <nova:ports>
Nov 11 01:42:16 user nova-compute[75215]:         <nova:port uuid="404153aa-e572-4f64-a3c7-c474c6811610">
Nov 11 01:42:16 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 11 01:42:16 user nova-compute[75215]:         </nova:port>
Nov 11 01:42:16 user nova-compute[75215]:       </nova:ports>
Nov 11 01:42:16 user nova-compute[75215]:     </nova:instance>
Nov 11 01:42:16 user nova-compute[75215]:   </metadata>
Nov 11 01:42:16 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:42:16 user nova-compute[75215]:     <system>
Nov 11 01:42:16 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:42:16 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:42:16 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:42:16 user nova-compute[75215]:       <entry name="serial">298c4f12-029f-407a-a71f-d5c722655f8d</entry>
Nov 11 01:42:16 user nova-compute[75215]:       <entry name="uuid">298c4f12-029f-407a-a71f-d5c722655f8d</entry>
Nov 11 01:42:16 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:42:16 user nova-compute[75215]:     </system>
Nov 11 01:42:16 user nova-compute[75215]:   </sysinfo>
Nov 11 01:42:16 user nova-compute[75215]:   <os>
Nov 11 01:42:16 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:42:16 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:42:16 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:42:16 user nova-compute[75215]:   </os>
Nov 11 01:42:16 user nova-compute[75215]:   <features>
Nov 11 01:42:16 user nova-compute[75215]:     <acpi/>
Nov 11 01:42:16 user nova-compute[75215]:     <apic/>
Nov 11 01:42:16 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:42:16 user nova-compute[75215]:   </features>
Nov 11 01:42:16 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:42:16 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:42:16 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:42:16 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:42:16 user nova-compute[75215]:   </clock>
Nov 11 01:42:16 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:42:16 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:42:16 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:42:16 user nova-compute[75215]:   </cpu>
Nov 11 01:42:16 user nova-compute[75215]:   <devices>
Nov 11 01:42:16 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:42:16 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:42:16 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 11 01:42:16 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:42:16 user nova-compute[75215]:       <serial>42983526-ca9e-4973-8891-7830b5f2fc1e</serial>
Nov 11 01:42:16 user nova-compute[75215]:     </disk>
Nov 11 01:42:16 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:42:16 user nova-compute[75215]:       <mac address="fa:16:3e:7c:37:65"/>
Nov 11 01:42:16 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:42:16 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:42:16 user nova-compute[75215]:       <target dev="tap404153aa-e5"/>
Nov 11 01:42:16 user nova-compute[75215]:     </interface>
Nov 11 01:42:16 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:42:16 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/298c4f12-029f-407a-a71f-d5c722655f8d/console.log" append="off"/>
Nov 11 01:42:16 user nova-compute[75215]:     </serial>
Nov 11 01:42:16 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:42:16 user nova-compute[75215]:     <video>
Nov 11 01:42:16 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:42:16 user nova-compute[75215]:     </video>
Nov 11 01:42:16 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:42:16 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:42:16 user nova-compute[75215]:     </rng>
Nov 11 01:42:16 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:42:16 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:42:16 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:42:16 user nova-compute[75215]:     </memballoon>
Nov 11 01:42:16 user nova-compute[75215]:   </devices>
Nov 11 01:42:16 user nova-compute[75215]: </domain>
Nov 11 01:42:16 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538928176',display_name='tempest-ServerActionsTestOtherA-server-538928176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538928176',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-tlmg4me0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=298c4f12-029f-407a-a71f-d5c722655f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG os_vif [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0dece9d-5c2c-40e7-a5d5-dca9ab8c3334 req-459b9e4f-155e-4c10-a7c5-399b7f0950b3 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-deleted-a6c38c23-70cb-47cd-aaa4-fc9ebd0a1ff8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0dece9d-5c2c-40e7-a5d5-dca9ab8c3334 req-459b9e4f-155e-4c10-a7c5-399b7f0950b3 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-deleted-58ba476f-668b-445a-b5f0-98e63a1d665f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0dece9d-5c2c-40e7-a5d5-dca9ab8c3334 req-459b9e4f-155e-4c10-a7c5-399b7f0950b3 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-deleted-83e59e94-7503-4236-b69f-c1b289c3f4a0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0dece9d-5c2c-40e7-a5d5-dca9ab8c3334 req-459b9e4f-155e-4c10-a7c5-399b7f0950b3 service nova] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Received event network-vif-deleted-c9cd4ac9-bf2f-4ab5-b656-2b886152f79d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'defcfe6f-ffa4-5a42-8da1-825e48398e91', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap404153aa-e5, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap404153aa-e5, col_values=(('qos', UUID('61d57cd2-cdb2-41f7-a546-b6b31ae24ad8')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap404153aa-e5, col_values=(('external_ids', {'iface-id': '404153aa-e572-4f64-a3c7-c474c6811610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:37:65', 'vm-uuid': '298c4f12-029f-407a-a71f-d5c722655f8d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:16 user nova-compute[75215]: INFO os_vif [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5')
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No VIF found with MAC fa:16:3e:7c:37:65, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-e558e201-7f45-43d5-9d31-6851dfffc508 req-83d6ffbc-5945-4e3d-884e-77743785be66 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e558e201-7f45-43d5-9d31-6851dfffc508 req-83d6ffbc-5945-4e3d-884e-77743785be66 service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e558e201-7f45-43d5-9d31-6851dfffc508 req-83d6ffbc-5945-4e3d-884e-77743785be66 service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e558e201-7f45-43d5-9d31-6851dfffc508 req-83d6ffbc-5945-4e3d-884e-77743785be66 service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-e558e201-7f45-43d5-9d31-6851dfffc508 req-83d6ffbc-5945-4e3d-884e-77743785be66 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:18 user nova-compute[75215]: WARNING nova.compute.manager [req-e558e201-7f45-43d5-9d31-6851dfffc508 req-83d6ffbc-5945-4e3d-884e-77743785be66 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state building and task_state spawning.
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:19 user nova-compute[75215]: INFO nova.compute.manager [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] [instance: e6560dd5-4f17-417d-bb0c-269e0284207d] Took 3.54 seconds to detach 3 volumes for instance.
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.674s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:20 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Deleted allocations for instance e6560dd5-4f17-417d-bb0c-269e0284207d
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e95ca8cc-3863-47c5-b2ac-f675fcda77d7 tempest-TaggedBootDevicesTest_v242-811690612 tempest-TaggedBootDevicesTest_v242-811690612-project-member] Lock "e6560dd5-4f17-417d-bb0c-269e0284207d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.199s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-2f52894d-c8b6-4a7b-9c34-9462317c7837 req-a3fa52a3-e184-4b0b-ac3c-aca649a5a62a service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2f52894d-c8b6-4a7b-9c34-9462317c7837 req-a3fa52a3-e184-4b0b-ac3c-aca649a5a62a service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2f52894d-c8b6-4a7b-9c34-9462317c7837 req-a3fa52a3-e184-4b0b-ac3c-aca649a5a62a service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2f52894d-c8b6-4a7b-9c34-9462317c7837 req-a3fa52a3-e184-4b0b-ac3c-aca649a5a62a service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-2f52894d-c8b6-4a7b-9c34-9462317c7837 req-a3fa52a3-e184-4b0b-ac3c-aca649a5a62a service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:42:20 user nova-compute[75215]: WARNING nova.compute.manager [req-2f52894d-c8b6-4a7b-9c34-9462317c7837 req-a3fa52a3-e184-4b0b-ac3c-aca649a5a62a service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state building and task_state spawning.
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:42:20 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance spawned successfully.
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:21 user nova-compute[75215]: INFO nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:42:21 user nova-compute[75215]: INFO nova.compute.manager [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Took 38.74 seconds to build instance.
Nov 11 01:42:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-df4b3856-8ea6-46d6-9b5e-c50d3eb2ce30 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.863s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:42:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:42:21 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7441MB free_disk=25.18386459350586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 323cc88a-b1b3-4a44-9674-818ba3e317f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 298c4f12-029f-407a-a71f-d5c722655f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:42:21 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:42:22 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:42:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:42:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:42:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:42:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Skipping network cache update for instance because it is Building. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 330defc6-9b43-4f1e-9a76-94b23750e1b0 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:42:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updating instance_info_cache with network_info: [{"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:42:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:42:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG os_brick.utils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21582dd-19c8-478c-892d-c67e0fe4082c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc5182a-c482-46cc-93c6-468fd12bd6ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ec67af-69c6-4c37-a9f0-138acac0d842]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97e869-8dbf-465c-80d5-13df79aae8b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:42:36 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:42:36 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad8920-9ce1-4d88-807d-9f57978813eb]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG os_brick.utils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Updating existing volume attachment record: 10563d73-a6e8-48bb-87e1-27427da511ae {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:42:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:42:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:42:56 user nova-compute[75215]: INFO nova.compute.manager [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Detaching volume be297bd8-4300-4833-a3a0-dbe6e12ab4ad
Nov 11 01:42:56 user nova-compute[75215]: INFO nova.virt.block_device [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Attempting to driver detach volume be297bd8-4300-4833-a3a0-dbe6e12ab4ad from mountpoint /dev/vdc
Nov 11 01:42:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Attempting to detach device vdc from instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:42:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:42:56 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:42:56 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:42:56 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 11 01:42:56 user nova-compute[75215]:   <serial>be297bd8-4300-4833-a3a0-dbe6e12ab4ad</serial>
Nov 11 01:42:56 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 01:42:56 user nova-compute[75215]: </disk>
Nov 11 01:42:56 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:42:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully detached device vdc from instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea from the persistent domain config.
Nov 11 01:42:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:42:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:42:56 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:42:56 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:42:56 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 11 01:42:56 user nova-compute[75215]:   <serial>be297bd8-4300-4833-a3a0-dbe6e12ab4ad</serial>
Nov 11 01:42:56 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 01:42:56 user nova-compute[75215]: </disk>
Nov 11 01:42:56 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:42:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:42:59 user nova-compute[75215]: INFO nova.compute.manager [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Rescuing
Nov 11 01:42:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:42:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquired lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:42:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:42:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:42:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updating instance_info_cache with network_info: [{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:42:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Releasing lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b4b06c16-32e8-4108-b6f8-2f609648fa1c req-b83cad96-10c2-45dd-a6b1-4db7d59e0fb7 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-unplugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b4b06c16-32e8-4108-b6f8-2f609648fa1c req-b83cad96-10c2-45dd-a6b1-4db7d59e0fb7 service nova] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b4b06c16-32e8-4108-b6f8-2f609648fa1c req-b83cad96-10c2-45dd-a6b1-4db7d59e0fb7 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b4b06c16-32e8-4108-b6f8-2f609648fa1c req-b83cad96-10c2-45dd-a6b1-4db7d59e0fb7 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-b4b06c16-32e8-4108-b6f8-2f609648fa1c req-b83cad96-10c2-45dd-a6b1-4db7d59e0fb7 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] No waiting events found dispatching network-vif-unplugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:00 user nova-compute[75215]: WARNING nova.compute.manager [req-b4b06c16-32e8-4108-b6f8-2f609648fa1c req-b83cad96-10c2-45dd-a6b1-4db7d59e0fb7 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received unexpected event network-vif-unplugged-3cc562bf-7bac-40d7-b6ee-db41336f434b for instance with vm_state active and task_state rescuing.
Nov 11 01:43:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Instance destroyed successfully.
Nov 11 01:43:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Attempting rescue
Nov 11 01:43:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 01:43:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Creating image(s)
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue" returned: 0 in 0.054s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'migration_context' on Instance uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<2797cb1b-a56d-47c4-9810-4d5cd424c4e9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Start _get_guest_xml network_info=[{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:92:64:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'resources' on Instance uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<2797cb1b-a56d-47c4-9810-4d5cd424c4e9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'numa_topology' on Instance uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<2797cb1b-a56d-47c4-9810-4d5cd424c4e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:43:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:43:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<2797cb1b-a56d-47c4-9810-4d5cd424c4e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752797510',display_name='tempest-ServerRescueNegativeTestJSON-server-1752797510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752797510',id=25,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-xrgv02un',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:18Z,user_data=None,user_id='2c11f7630148412285910f06eade4923',uuid=2797cb1b-a56d-47c4-9810-4d5cd424c4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:92:64:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:92:64:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:64:a6,bridge_name='br-int',has_traffic_filtering=True,id=3cc562bf-7bac-40d7-b6ee-db41336f434b,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc562bf-7b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'pci_devices' on Instance uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.objects.base [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<2797cb1b-a56d-47c4-9810-4d5cd424c4e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:43:01 user nova-compute[75215]:   <uuid>2797cb1b-a56d-47c4-9810-4d5cd424c4e9</uuid>
Nov 11 01:43:01 user nova-compute[75215]:   <name>instance-00000019</name>
Nov 11 01:43:01 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:43:01 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:43:01 user nova-compute[75215]:   <metadata>
Nov 11 01:43:01 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:43:01 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:43:01 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1752797510</nova:name>
Nov 11 01:43:01 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:43:01</nova:creationTime>
Nov 11 01:43:01 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:43:01 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:43:01 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:43:01 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:43:01 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:43:01 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:43:01 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:43:01 user nova-compute[75215]:       <nova:owner>
Nov 11 01:43:01 user nova-compute[75215]:         <nova:user uuid="2c11f7630148412285910f06eade4923">tempest-ServerRescueNegativeTestJSON-107483545-project-member</nova:user>
Nov 11 01:43:01 user nova-compute[75215]:         <nova:project uuid="dddded455ac3456e9316603170bb6fea">tempest-ServerRescueNegativeTestJSON-107483545</nova:project>
Nov 11 01:43:01 user nova-compute[75215]:       </nova:owner>
Nov 11 01:43:01 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:43:01 user nova-compute[75215]:       <nova:ports>
Nov 11 01:43:01 user nova-compute[75215]:         <nova:port uuid="3cc562bf-7bac-40d7-b6ee-db41336f434b">
Nov 11 01:43:01 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:43:01 user nova-compute[75215]:         </nova:port>
Nov 11 01:43:01 user nova-compute[75215]:       </nova:ports>
Nov 11 01:43:01 user nova-compute[75215]:     </nova:instance>
Nov 11 01:43:01 user nova-compute[75215]:   </metadata>
Nov 11 01:43:01 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:43:01 user nova-compute[75215]:     <system>
Nov 11 01:43:01 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:43:01 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:43:01 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:43:01 user nova-compute[75215]:       <entry name="serial">2797cb1b-a56d-47c4-9810-4d5cd424c4e9</entry>
Nov 11 01:43:01 user nova-compute[75215]:       <entry name="uuid">2797cb1b-a56d-47c4-9810-4d5cd424c4e9</entry>
Nov 11 01:43:01 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:43:01 user nova-compute[75215]:     </system>
Nov 11 01:43:01 user nova-compute[75215]:   </sysinfo>
Nov 11 01:43:01 user nova-compute[75215]:   <os>
Nov 11 01:43:01 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:43:01 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:43:01 user nova-compute[75215]:   </os>
Nov 11 01:43:01 user nova-compute[75215]:   <features>
Nov 11 01:43:01 user nova-compute[75215]:     <acpi/>
Nov 11 01:43:01 user nova-compute[75215]:     <apic/>
Nov 11 01:43:01 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:43:01 user nova-compute[75215]:   </features>
Nov 11 01:43:01 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:43:01 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:43:01 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:43:01 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:43:01 user nova-compute[75215]:   </clock>
Nov 11 01:43:01 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:43:01 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:43:01 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:43:01 user nova-compute[75215]:   </cpu>
Nov 11 01:43:01 user nova-compute[75215]:   <devices>
Nov 11 01:43:01 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:43:01 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:43:01 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue"/>
Nov 11 01:43:01 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:43:01 user nova-compute[75215]:     </disk>
Nov 11 01:43:01 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:43:01 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:43:01 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk"/>
Nov 11 01:43:01 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:43:01 user nova-compute[75215]:     </disk>
Nov 11 01:43:01 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:43:01 user nova-compute[75215]:       <mac address="fa:16:3e:92:64:a6"/>
Nov 11 01:43:01 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:43:01 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:43:01 user nova-compute[75215]:       <target dev="tap3cc562bf-7b"/>
Nov 11 01:43:01 user nova-compute[75215]:     </interface>
Nov 11 01:43:01 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:43:01 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/console.log" append="off"/>
Nov 11 01:43:01 user nova-compute[75215]:     </serial>
Nov 11 01:43:01 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:43:01 user nova-compute[75215]:     <video>
Nov 11 01:43:01 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:43:01 user nova-compute[75215]:     </video>
Nov 11 01:43:01 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:43:01 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:43:01 user nova-compute[75215]:     </rng>
Nov 11 01:43:01 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:43:01 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:43:01 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:43:01 user nova-compute[75215]:     </memballoon>
Nov 11 01:43:01 user nova-compute[75215]:   </devices>
Nov 11 01:43:01 user nova-compute[75215]: </domain>
Nov 11 01:43:01 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:43:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Instance destroyed successfully.
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No VIF found with MAC fa:16:3e:92:64:a6, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:43:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ee86c05-c288-4251-abe8-1fa2c8106a87 req-dd8da44e-7c1e-4668-be1c-29415e64ba5f service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ee86c05-c288-4251-abe8-1fa2c8106a87 req-dd8da44e-7c1e-4668-be1c-29415e64ba5f service nova] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ee86c05-c288-4251-abe8-1fa2c8106a87 req-dd8da44e-7c1e-4668-be1c-29415e64ba5f service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ee86c05-c288-4251-abe8-1fa2c8106a87 req-dd8da44e-7c1e-4668-be1c-29415e64ba5f service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ee86c05-c288-4251-abe8-1fa2c8106a87 req-dd8da44e-7c1e-4668-be1c-29415e64ba5f service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] No waiting events found dispatching network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:02 user nova-compute[75215]: WARNING nova.compute.manager [req-7ee86c05-c288-4251-abe8-1fa2c8106a87 req-dd8da44e-7c1e-4668-be1c-29415e64ba5f service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received unexpected event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b for instance with vm_state active and task_state rescuing.
Nov 11 01:43:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:43:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Creating image(s)
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Ensure instance console log exists: /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Start _get_guest_xml network_info=[{"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '10563d73-a6e8-48bb-87e1-27427da511ae', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJMBxgLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ac25219-b9e6-4698-b6e4-1d6c5653cfc9', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'serial': 'fa1398e5-6ecf-4aae-9962-62ad0736ade9'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] No waiting events found dispatching network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:04 user nova-compute[75215]: WARNING nova.compute.manager [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received unexpected event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b for instance with vm_state active and task_state rescuing.
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] No waiting events found dispatching network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:04 user nova-compute[75215]: WARNING nova.compute.manager [req-6b93c94a-bf13-4132-a768-71fcc543861a req-041d16d6-5b8d-4f01-9032-984cdc9e14a3 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received unexpected event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b for instance with vm_state active and task_state rescuing.
Nov 11 01:43:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:43:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJMBxgLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:43:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:43:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:43:04 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[102f8002-ebb5-4c32-badc-6cdf6b3106f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:43:04 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6e20f-791c-45ed-b77a-97fc00a9bcad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9] added
Nov 11 01:43:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[711815f8-0a2a-43e8-80fd-8d63330bde6d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d1604-d825-41c0-8b11-abcb24d0fbe6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJMBxgLY {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJMBxgLY" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[372650e4-0a40-42e0-90ce-507caa132c77]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJMBxgLY'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[489ca349-1997-4051-b3be-064b19172228]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[48632ba6-766e-4ae1-83ba-3bf85792f9b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:43:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:43:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[113ee3d0-e088-46f6-95ae-e9d82d9b063e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9, portal: 172.16.0.220,3260]
Nov 11 01:43:04 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9, portal: 172.16.0.220,3260] successful.
Nov 11 01:43:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39dc22e-99ba-4828-86ed-528d569aa720]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[502cf58b-a2d2-4dd0-b5ab-8143d0189022]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:43:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:43:04 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:43:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[356e4443-09d4-4bb9-a0b0-3ab5ae73da00]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:43:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJMBxgLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-88f49237-b83b-4d9d-b111-5bf30155691a tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23066616562386236', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066616562386236', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1717157221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1717157221',id=27,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-oc54hq59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:50Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=7ac25219-b9e6-4698-b6e4-1d6c5653cfc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e7:25,bridge_name='br-int',has_traffic_filtering=True,id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fc7525-cd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:43:05 user nova-compute[75215]:   <uuid>7ac25219-b9e6-4698-b6e4-1d6c5653cfc9</uuid>
Nov 11 01:43:05 user nova-compute[75215]:   <name>instance-0000001b</name>
Nov 11 01:43:05 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:43:05 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:43:05 user nova-compute[75215]:   <metadata>
Nov 11 01:43:05 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:43:05 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:43:05 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1717157221</nova:name>
Nov 11 01:43:05 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:43:04</nova:creationTime>
Nov 11 01:43:05 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:43:05 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:43:05 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:43:05 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:43:05 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:43:05 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:43:05 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:43:05 user nova-compute[75215]:       <nova:owner>
Nov 11 01:43:05 user nova-compute[75215]:         <nova:user uuid="561ad55121d44be1ab7971a495b9347f">tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member</nova:user>
Nov 11 01:43:05 user nova-compute[75215]:         <nova:project uuid="32564a70b861419eaefcb97cd327088d">tempest-ServerBootFromVolumeStableRescueTest-1327607516</nova:project>
Nov 11 01:43:05 user nova-compute[75215]:       </nova:owner>
Nov 11 01:43:05 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:43:05 user nova-compute[75215]:       <nova:ports>
Nov 11 01:43:05 user nova-compute[75215]:         <nova:port uuid="79fc7525-cd86-430b-a28f-40f2e0e6c0fe">
Nov 11 01:43:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:43:05 user nova-compute[75215]:         </nova:port>
Nov 11 01:43:05 user nova-compute[75215]:       </nova:ports>
Nov 11 01:43:05 user nova-compute[75215]:     </nova:instance>
Nov 11 01:43:05 user nova-compute[75215]:   </metadata>
Nov 11 01:43:05 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:43:05 user nova-compute[75215]:     <system>
Nov 11 01:43:05 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:43:05 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:43:05 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:43:05 user nova-compute[75215]:       <entry name="serial">7ac25219-b9e6-4698-b6e4-1d6c5653cfc9</entry>
Nov 11 01:43:05 user nova-compute[75215]:       <entry name="uuid">7ac25219-b9e6-4698-b6e4-1d6c5653cfc9</entry>
Nov 11 01:43:05 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:43:05 user nova-compute[75215]:     </system>
Nov 11 01:43:05 user nova-compute[75215]:   </sysinfo>
Nov 11 01:43:05 user nova-compute[75215]:   <os>
Nov 11 01:43:05 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:43:05 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:43:05 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:43:05 user nova-compute[75215]:   </os>
Nov 11 01:43:05 user nova-compute[75215]:   <features>
Nov 11 01:43:05 user nova-compute[75215]:     <acpi/>
Nov 11 01:43:05 user nova-compute[75215]:     <apic/>
Nov 11 01:43:05 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:43:05 user nova-compute[75215]:   </features>
Nov 11 01:43:05 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:43:05 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:43:05 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:43:05 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:43:05 user nova-compute[75215]:   </clock>
Nov 11 01:43:05 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:43:05 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:43:05 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:43:05 user nova-compute[75215]:   </cpu>
Nov 11 01:43:05 user nova-compute[75215]:   <devices>
Nov 11 01:43:05 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:43:05 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:43:05 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 11 01:43:05 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:43:05 user nova-compute[75215]:       <serial>fa1398e5-6ecf-4aae-9962-62ad0736ade9</serial>
Nov 11 01:43:05 user nova-compute[75215]:     </disk>
Nov 11 01:43:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:43:05 user nova-compute[75215]:       <mac address="fa:16:3e:e5:e7:25"/>
Nov 11 01:43:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:43:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:43:05 user nova-compute[75215]:       <target dev="tap79fc7525-cd"/>
Nov 11 01:43:05 user nova-compute[75215]:     </interface>
Nov 11 01:43:05 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:43:05 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/console.log" append="off"/>
Nov 11 01:43:05 user nova-compute[75215]:     </serial>
Nov 11 01:43:05 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:43:05 user nova-compute[75215]:     <video>
Nov 11 01:43:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:43:05 user nova-compute[75215]:     </video>
Nov 11 01:43:05 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:43:05 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:43:05 user nova-compute[75215]:     </rng>
Nov 11 01:43:05 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:43:05 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:43:05 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:43:05 user nova-compute[75215]:     </memballoon>
Nov 11 01:43:05 user nova-compute[75215]:   </devices>
Nov 11 01:43:05 user nova-compute[75215]: </domain>
Nov 11 01:43:05 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1717157221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1717157221',id=27,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-oc54hq59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:50Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=7ac25219-b9e6-4698-b6e4-1d6c5653cfc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e7:25,bridge_name='br-int',has_traffic_filtering=True,id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fc7525-cd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG os_vif [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e7:25,bridge_name='br-int',has_traffic_filtering=True,id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fc7525-cd') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fb38484-7347-50d3-940e-2cf575764c0e', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79fc7525-cd, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79fc7525-cd, col_values=(('qos', UUID('723b27bc-c1e3-4ffb-8ead-c23d65c50cf0')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79fc7525-cd, col_values=(('external_ids', {'iface-id': '79fc7525-cd86-430b-a28f-40f2e0e6c0fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:e7:25', 'vm-uuid': '7ac25219-b9e6-4698-b6e4-1d6c5653cfc9'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:05 user nova-compute[75215]: INFO os_vif [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e7:25,bridge_name='br-int',has_traffic_filtering=True,id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fc7525-cd')
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:43:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No VIF found with MAC fa:16:3e:e5:e7:25, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:43:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-fdee8953-b052-4d6f-a163-8ab36f83fa3c req-70ffaf3b-a146-4f92-a1e5-dfc7acf6ca5b service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fdee8953-b052-4d6f-a163-8ab36f83fa3c req-70ffaf3b-a146-4f92-a1e5-dfc7acf6ca5b service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fdee8953-b052-4d6f-a163-8ab36f83fa3c req-70ffaf3b-a146-4f92-a1e5-dfc7acf6ca5b service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fdee8953-b052-4d6f-a163-8ab36f83fa3c req-70ffaf3b-a146-4f92-a1e5-dfc7acf6ca5b service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-fdee8953-b052-4d6f-a163-8ab36f83fa3c req-70ffaf3b-a146-4f92-a1e5-dfc7acf6ca5b service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:07 user nova-compute[75215]: WARNING nova.compute.manager [req-fdee8953-b052-4d6f-a163-8ab36f83fa3c req-70ffaf3b-a146-4f92-a1e5-dfc7acf6ca5b service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state building and task_state spawning.
Nov 11 01:43:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf4521c9-513b-49b7-baf6-5bcc3bcb64c9 req-39f577b5-48f4-4446-8be4-4c4e2d8258b7 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf4521c9-513b-49b7-baf6-5bcc3bcb64c9 req-39f577b5-48f4-4446-8be4-4c4e2d8258b7 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf4521c9-513b-49b7-baf6-5bcc3bcb64c9 req-39f577b5-48f4-4446-8be4-4c4e2d8258b7 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf4521c9-513b-49b7-baf6-5bcc3bcb64c9 req-39f577b5-48f4-4446-8be4-4c4e2d8258b7 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf4521c9-513b-49b7-baf6-5bcc3bcb64c9 req-39f577b5-48f4-4446-8be4-4c4e2d8258b7 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:09 user nova-compute[75215]: WARNING nova.compute.manager [req-bf4521c9-513b-49b7-baf6-5bcc3bcb64c9 req-39f577b5-48f4-4446-8be4-4c4e2d8258b7 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state building and task_state spawning.
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:43:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance spawned successfully.
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:43:10 user nova-compute[75215]: INFO nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 11 01:43:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:43:10 user nova-compute[75215]: INFO nova.compute.manager [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Took 81.02 seconds to build instance.
Nov 11 01:43:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d34dcb51-1a66-4cd6-b020-5cf88e66e9e0 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 81.133s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lazy-loading 'flavor' on Instance uuid 323cc88a-b1b3-4a44-9674-818ba3e317f2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:11 user nova-compute[75215]: INFO nova.compute.manager [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Attaching volume a697d2a3-05b4-4370-a256-944c0a4333b3 to /dev/vdb
Nov 11 01:43:12 user nova-compute[75215]: DEBUG os_brick.utils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b634087e-b889-4410-ba0a-2068613e6448]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe9508c-f58d-42cc-a7a7-b8f9e526b19e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1279e3a7-58c6-46f9-89fa-5dffc62fc6d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[43373278-138b-4ca5-bd90-4920b0f07803]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:43:12 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:43:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[53833635-d41d-427a-a44f-0edffbc6830a]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG os_brick.utils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:43:12 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Updating existing volume attachment record: 77a6c637-5fe1-4dd2-a963-e375faec04b4 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:43:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:43:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:43:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:43:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:43:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:16 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea is timed out.
Nov 11 01:43:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully detached device vdc from instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea from the live domain config.
Nov 11 01:43:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZvKqMsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:43:16 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:43:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac42b30d-88fe-44c4-9f51-bf7b18743915]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:43:16 user nova-compute[75215]: No targets found.
Nov 11 01:43:16 user nova-compute[75215]: iSNS:
Nov 11 01:43:16 user nova-compute[75215]: No targets found.
Nov 11 01:43:16 user nova-compute[75215]: STATIC:
Nov 11 01:43:16 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f
Nov 11 01:43:16 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:16 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:16 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad
Nov 11 01:43:16 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:16 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:16 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e
Nov 11 01:43:16 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:16 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:16 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9
Nov 11 01:43:16 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:16 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:16 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:43:16 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:16 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:16 user nova-compute[75215]: FIRMWARE:
Nov 11 01:43:16 user nova-compute[75215]: No targets found.
Nov 11 01:43:16 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:43:16 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:43:16 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:43:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b851e0a-4e94-48bd-b0f4-1bf758ddd727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd2af05-f712-41cd-bb92-baa6d8a93b46]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:43:17 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:43:17 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:43:17 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:43:17 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:43:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:43:17 user nova-compute[75215]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad (non-flash)
Nov 11 01:43:17 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:43:17 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:43:17 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:43:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40442d7910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7912fa88-115c-4c3a-8cbf-5574788bebad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a89630-6b3f-4398-a143-744497393100]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d03051-a45b-46fa-bc14-68c848084d48]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcf4fce-c801-4a72-8972-40046b3233ad]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[476a15db-bbb3-4b59-a44e-265a2a5c5428]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e658ec1-5f30-4601-a460-81354ae9e590]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad, portal: 172.16.0.220,3260]
Nov 11 01:43:17 user nova-compute[75215]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad, portal: 172.16.0.220,3260] successful.
Nov 11 01:43:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be297bd8-4300-4833-a3a0-dbe6e12ab4ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1671a79-2dd8-437b-8644-d761deaffa7e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] <== disconnect_volume: return (382ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:43:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:43:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:18 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:43:18 user nova-compute[75215]: DEBUG nova.objects.instance [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'flavor' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-839439ac-a736-485a-9697-a2c7cef05817 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.267s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:43:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:43:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:24 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:43:24 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7226MB free_disk=25.14059066772461GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 323cc88a-b1b3-4a44-9674-818ba3e317f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 298c4f12-029f-407a-a71f-d5c722655f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:43:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:43:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:43:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-82bd212a-7d88-4715-8da4-125f9905db24 req-d0c57972-67f6-48b3-9d3c-e2605a65bd07 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-changed-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-82bd212a-7d88-4715-8da4-125f9905db24 req-d0c57972-67f6-48b3-9d3c-e2605a65bd07 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Refreshing instance network info cache due to event network-changed-544706ff-9665-4194-8957-4435ae082aac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:43:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-82bd212a-7d88-4715-8da4-125f9905db24 req-d0c57972-67f6-48b3-9d3c-e2605a65bd07 service nova] Acquiring lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:43:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-82bd212a-7d88-4715-8da4-125f9905db24 req-d0c57972-67f6-48b3-9d3c-e2605a65bd07 service nova] Acquired lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:43:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-82bd212a-7d88-4715-8da4-125f9905db24 req-d0c57972-67f6-48b3-9d3c-e2605a65bd07 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Refreshing network info cache for port 544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:43:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-82bd212a-7d88-4715-8da4-125f9905db24 req-d0c57972-67f6-48b3-9d3c-e2605a65bd07 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updated VIF entry in instance network info cache for port 544706ff-9665-4194-8957-4435ae082aac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:43:34 user nova-compute[75215]: DEBUG nova.network.neutron [req-82bd212a-7d88-4715-8da4-125f9905db24 req-d0c57972-67f6-48b3-9d3c-e2605a65bd07 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [{"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-82bd212a-7d88-4715-8da4-125f9905db24 req-d0c57972-67f6-48b3-9d3c-e2605a65bd07 service nova] Releasing lock "refresh_cache-ad403c50-a8fe-442f-9189-0a6925580739" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Stashing vm_state: active {{(pid=75215) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-96fc097c-891f-484d-8a31-f0cb5a914072 req-3eb64133-edf0-41db-846f-f522db4c7193 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-changed-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-96fc097c-891f-484d-8a31-f0cb5a914072 req-3eb64133-edf0-41db-846f-f522db4c7193 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Refreshing instance network info cache due to event network-changed-404153aa-e572-4f64-a3c7-c474c6811610. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-96fc097c-891f-484d-8a31-f0cb5a914072 req-3eb64133-edf0-41db-846f-f522db4c7193 service nova] Acquiring lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-96fc097c-891f-484d-8a31-f0cb5a914072 req-3eb64133-edf0-41db-846f-f522db4c7193 service nova] Acquired lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG nova.network.neutron [req-96fc097c-891f-484d-8a31-f0cb5a914072 req-3eb64133-edf0-41db-846f-f522db4c7193 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Refreshing network info cache for port 404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:43:35 user nova-compute[75215]: INFO nova.compute.claims [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Claim successful on node user
Nov 11 01:43:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:35 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating resource usage from migration ad65b427-adac-4d1d-b712-840ca87f0c9d
Nov 11 01:43:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-96fc097c-891f-484d-8a31-f0cb5a914072 req-3eb64133-edf0-41db-846f-f522db4c7193 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updated VIF entry in instance network info cache for port 404153aa-e572-4f64-a3c7-c474c6811610. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG nova.network.neutron [req-96fc097c-891f-484d-8a31-f0cb5a914072 req-3eb64133-edf0-41db-846f-f522db4c7193 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating instance_info_cache with network_info: [{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-96fc097c-891f-484d-8a31-f0cb5a914072 req-3eb64133-edf0-41db-846f-f522db4c7193 service nova] Releasing lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.878s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:36 user nova-compute[75215]: INFO nova.compute.manager [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Migrating
Nov 11 01:43:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:43:36 user nova-compute[75215]: INFO nova.compute.rpcapi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 11 01:43:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquired lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:43:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating instance_info_cache with network_info: [{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Releasing lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Starting migrate_disk_and_power_off {{(pid=75215) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-3932e638-a907-420e-843d-63c1384d1ac3 req-9895870a-238b-4295-8446-44327870f02c service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3932e638-a907-420e-843d-63c1384d1ac3 req-9895870a-238b-4295-8446-44327870f02c service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3932e638-a907-420e-843d-63c1384d1ac3 req-9895870a-238b-4295-8446-44327870f02c service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3932e638-a907-420e-843d-63c1384d1ac3 req-9895870a-238b-4295-8446-44327870f02c service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-3932e638-a907-420e-843d-63c1384d1ac3 req-9895870a-238b-4295-8446-44327870f02c service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:37 user nova-compute[75215]: WARNING nova.compute.manager [req-3932e638-a907-420e-843d-63c1384d1ac3 req-9895870a-238b-4295-8446-44327870f02c service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state active and task_state resize_migrating.
Nov 11 01:43:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance destroyed successfully.
Nov 11 01:43:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538928176',display_name='tempest-ServerActionsTestOtherA-server-538928176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538928176',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-tlmg4me0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=298c4f12-029f-407a-a71f-d5c722655f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1630024766-network", "vif_mac": "fa:16:3e:7c:37:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1630024766-network", "vif_mac": "fa:16:3e:7c:37:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_vif [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap404153aa-e5, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61d57cd2-cdb2-41f7-a546-b6b31ae24ad8) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:43:38 user nova-compute[75215]: INFO os_vif [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5')
Nov 11 01:43:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGOIeEap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:43:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c5a5bc-774a-41d6-bbb9-d8a9a2e5f312]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:43:38 user nova-compute[75215]: No targets found.
Nov 11 01:43:38 user nova-compute[75215]: iSNS:
Nov 11 01:43:38 user nova-compute[75215]: No targets found.
Nov 11 01:43:38 user nova-compute[75215]: STATIC:
Nov 11 01:43:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f
Nov 11 01:43:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:38 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e
Nov 11 01:43:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:38 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9
Nov 11 01:43:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:38 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:43:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:43:38 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:43:38 user nova-compute[75215]: FIRMWARE:
Nov 11 01:43:38 user nova-compute[75215]: No targets found.
Nov 11 01:43:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:43:38 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:43:38 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f387fe-1605-48d9-a72a-49df2a5080f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f8ffdd-af29-44fe-b8f9-afa75627da7c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:43:38 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:43:38 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:43:38 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:43:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:43:38 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:43:38 user nova-compute[75215]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:43:38 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:43:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4068a2ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d299d0-4f6a-4adf-bea5-b0d4bfb13204]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcb8d57-f884-46fb-b0d3-484e53f99b4e]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[579377c7-2663-482f-ade5-e18a42330940]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae270311-6513-4c45-94c6-1c5146b41c95]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26338323931383036', '/dev/disk/by-id/scsi-1SCST_BIOa083e062-c8291806dd1fd50a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a083e062') {{(pid=86647) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8234e5-5cad-4321-8a10-79305351153b]: (4, None) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59328b-d510-4030-9a58-a74a992c1521]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4f7c04-0214-48b9-846a-8dfd2aad7a52]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260]
Nov 11 01:43:38 user nova-compute[75215]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260] successful.
Nov 11 01:43:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2d53ff-6731-4b2f-9512-44d047d470fa]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== disconnect_volume: return (440ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:43:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Port 404153aa-e572-4f64-a3c7-c474c6811610 binding to destination host user is already ACTIVE {{(pid=75215) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:39 user nova-compute[75215]: WARNING nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state active and task_state resize_migrating.
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:39 user nova-compute[75215]: WARNING nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state active and task_state resize_migrating.
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:39 user nova-compute[75215]: WARNING nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state active and task_state resize_migrating.
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:39 user nova-compute[75215]: WARNING nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state active and task_state resize_migrating.
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:39 user nova-compute[75215]: WARNING nova.compute.manager [req-4f461fb0-d6e9-4b54-aa80-014600693c6a req-a963437f-faef-497e-9840-4272dd19e1dc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state active and task_state resize_migrating.
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.volume.cinder [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Update attachment failed for attachment 77a6c637-5fe1-4dd2-a963-e375faec04b4. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d4743b31-a331-4d4b-892f-e7eccff15bb2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d4743b31-a331-4d4b-892f-e7eccff15bb2)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Failed to attach a697d2a3-05b4-4370-a256-944c0a4333b3 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d4743b31-a331-4d4b-892f-e7eccff15bb2)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Traceback (most recent call last):
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     ret_val = method(obj, context, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     self._do_attach(context, instance, volume, volume_api,
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     self._volume_attach(context, volume, connector, instance,
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     connection_info = volume_api.attachment_update(
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     res = method(self, ctx, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     with excutils.save_and_reraise_exception():
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     self.force_reraise()
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     raise self.value
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     context, '3.44', skip_version_check=True).attachments.update(
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     return method.func(obj, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     resp = self._update('/attachments/%s' % id, body)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     return self._cs_request(url, 'PUT', **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     return self.request(url, method, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2]     raise exceptions.from_response(resp, body)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d4743b31-a331-4d4b-892f-e7eccff15bb2)
Nov 11 01:43:40 user nova-compute[75215]: ERROR nova.compute.manager [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] 
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquired lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.220s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server [None req-752225a7-5630-4902-a6df-b11b3fe2ab08 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d4743b31-a331-4d4b-892f-e7eccff15bb2)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d4743b31-a331-4d4b-892f-e7eccff15bb2)
Nov 11 01:43:40 user nova-compute[75215]: ERROR oslo_messaging.rpc.server 
Nov 11 01:43:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating instance_info_cache with network_info: [{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Releasing lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG os_brick.utils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8044b098-f8d8-44d9-9cc9-2b79ca72d963]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e524da9f-94b2-4111-aa0d-1e664d152459]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1d6f91-3533-4669-981b-1400a7ddf6db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef227fc-3c7f-4247-9d86-58289dfaed93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:43:40 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:43:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a433b73-b7a8-42eb-8bce-7fe24dc64cc2]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:43:40 user nova-compute[75215]: DEBUG os_brick.utils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:43:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cc7696f-3ca1-4581-8ab6-56b483bb4d76 req-083b8e9a-0ba3-41b4-8d95-4ba9c619d720 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-changed-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-5cc7696f-3ca1-4581-8ab6-56b483bb4d76 req-083b8e9a-0ba3-41b4-8d95-4ba9c619d720 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Refreshing instance network info cache due to event network-changed-2482e1e9-0789-46f8-a0c1-db7b0c189d46. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:43:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cc7696f-3ca1-4581-8ab6-56b483bb4d76 req-083b8e9a-0ba3-41b4-8d95-4ba9c619d720 service nova] Acquiring lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:43:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cc7696f-3ca1-4581-8ab6-56b483bb4d76 req-083b8e9a-0ba3-41b4-8d95-4ba9c619d720 service nova] Acquired lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:43:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cc7696f-3ca1-4581-8ab6-56b483bb4d76 req-083b8e9a-0ba3-41b4-8d95-4ba9c619d720 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Refreshing network info cache for port 2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:43:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cc7696f-3ca1-4581-8ab6-56b483bb4d76 req-083b8e9a-0ba3-41b4-8d95-4ba9c619d720 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updated VIF entry in instance network info cache for port 2482e1e9-0789-46f8-a0c1-db7b0c189d46. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:43:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-5cc7696f-3ca1-4581-8ab6-56b483bb4d76 req-083b8e9a-0ba3-41b4-8d95-4ba9c619d720 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updating instance_info_cache with network_info: [{"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5cc7696f-3ca1-4581-8ab6-56b483bb4d76 req-083b8e9a-0ba3-41b4-8d95-4ba9c619d720 service nova] Releasing lock "refresh_cache-19d13739-5512-48f7-a79c-d5b87fb9cc78" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:46 user nova-compute[75215]: INFO nova.compute.manager [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Terminating instance
Nov 11 01:43:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Instance destroyed successfully.
Nov 11 01:43:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'resources' on Instance uuid c26d1d9c-4086-4d2a-9551-b1c4b388b0ea {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-50013957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-50013957',id=16,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQho/bCGrdZjcyqN99hrRAj160xs5F2vrlEMeo4CuZhGRjtH+zSm55GqZ4SsRaTZmKJMk/2U6gXbQDYUX/BJ4mNp2SiIyVFBV9BEnjC2HItbMPv+SwGDbBUux0PjTK0Uw==',key_name='tempest-keypair-118414557',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:41:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-fj250k7w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=c26d1d9c-4086-4d2a-9551-b1c4b388b0ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "c546474a-e342-4eee-8398-789477c6a76d", "address": "fa:16:3e:2a:54:ac", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc546474a-e3", "ovs_interfaceid": "c546474a-e342-4eee-8398-789477c6a76d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG os_vif [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc546474a-e3, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34cd55b3-760d-4619-abff-4bfa3b5120c9) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:43:47 user nova-compute[75215]: INFO os_vif [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:54:ac,bridge_name='br-int',has_traffic_filtering=True,id=c546474a-e342-4eee-8398-789477c6a76d,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc546474a-e3')
Nov 11 01:43:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Deleting instance files /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea_del
Nov 11 01:43:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Deletion of /opt/stack/data/nova/instances/c26d1d9c-4086-4d2a-9551-b1c4b388b0ea_del complete
Nov 11 01:43:47 user nova-compute[75215]: INFO nova.compute.manager [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 11 01:43:47 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:43:47 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:43:48 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-f7211a9a-ba56-4c14-9657-5a14fbca125d req-babf3c90-5946-4525-8d34-0b481c01e509 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Received event network-vif-deleted-c546474a-e342-4eee-8398-789477c6a76d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:48 user nova-compute[75215]: INFO nova.compute.manager [req-f7211a9a-ba56-4c14-9657-5a14fbca125d req-babf3c90-5946-4525-8d34-0b481c01e509 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Neutron deleted interface c546474a-e342-4eee-8398-789477c6a76d; detaching it from the instance and deleting it from the info cache
Nov 11 01:43:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-f7211a9a-ba56-4c14-9657-5a14fbca125d req-babf3c90-5946-4525-8d34-0b481c01e509 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:48 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Took 1.20 seconds to deallocate network for instance.
Nov 11 01:43:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-f7211a9a-ba56-4c14-9657-5a14fbca125d req-babf3c90-5946-4525-8d34-0b481c01e509 service nova] [instance: c26d1d9c-4086-4d2a-9551-b1c4b388b0ea] Detach interface failed, port_id=c546474a-e342-4eee-8398-789477c6a76d, reason: Instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:43:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:49 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:43:49 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:43:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:49 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Deleted allocations for instance c26d1d9c-4086-4d2a-9551-b1c4b388b0ea
Nov 11 01:43:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1c10fabf-3cdb-4de1-9e53-fc3feb67c3e8 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "c26d1d9c-4086-4d2a-9551-b1c4b388b0ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.936s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:58 user nova-compute[75215]: INFO nova.compute.manager [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Attaching volume 4f1f87d0-2756-4326-9b1e-d985cc49f528 to /dev/vdb
Nov 11 01:43:58 user nova-compute[75215]: DEBUG os_brick.utils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2259811b-8188-4415-949a-37b68c8367e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[721357c9-154a-48a2-92df-2d604fa39f9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d5f73a-03ee-43b5-89c6-bcd4ba80de62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeef1a2-3ed2-4efb-b02b-cc1486c8254d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:43:58 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a322f50e-b756-492d-9994-81987a7e2fe1]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG os_brick.utils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updating existing volume attachment record: 83af7491-c3dd-4ef7-8abb-8292945fd6d0 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-594bd78f-4dbb-4559-afde-68841762ac1e req-2964b4ea-26c3-4df4-acab-f0a0ba6a4f4b service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received event network-changed-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-594bd78f-4dbb-4559-afde-68841762ac1e req-2964b4ea-26c3-4df4-acab-f0a0ba6a4f4b service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Refreshing instance network info cache due to event network-changed-4c773def-22ad-458a-8eb1-6f3b86e495f0. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-594bd78f-4dbb-4559-afde-68841762ac1e req-2964b4ea-26c3-4df4-acab-f0a0ba6a4f4b service nova] Acquiring lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-594bd78f-4dbb-4559-afde-68841762ac1e req-2964b4ea-26c3-4df4-acab-f0a0ba6a4f4b service nova] Acquired lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:43:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-594bd78f-4dbb-4559-afde-68841762ac1e req-2964b4ea-26c3-4df4-acab-f0a0ba6a4f4b service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Refreshing network info cache for port 4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:59 user nova-compute[75215]: INFO nova.compute.manager [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Terminating instance
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-594bd78f-4dbb-4559-afde-68841762ac1e req-2964b4ea-26c3-4df4-acab-f0a0ba6a4f4b service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Updated VIF entry in instance network info cache for port 4c773def-22ad-458a-8eb1-6f3b86e495f0. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.network.neutron [req-594bd78f-4dbb-4559-afde-68841762ac1e req-2964b4ea-26c3-4df4-acab-f0a0ba6a4f4b service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Updating instance_info_cache with network_info: [{"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-594bd78f-4dbb-4559-afde-68841762ac1e req-2964b4ea-26c3-4df4-acab-f0a0ba6a4f4b service nova] Releasing lock "refresh_cache-43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:43:59 user nova-compute[75215]: INFO nova.compute.claims [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Claim successful on node user
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-6a29fa72-117d-4b21-9ab2-ba72496716f6 req-af40227b-ea16-4cdf-a2d9-e22d848afdb9 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received event network-vif-unplugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6a29fa72-117d-4b21-9ab2-ba72496716f6 req-af40227b-ea16-4cdf-a2d9-e22d848afdb9 service nova] Acquiring lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6a29fa72-117d-4b21-9ab2-ba72496716f6 req-af40227b-ea16-4cdf-a2d9-e22d848afdb9 service nova] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6a29fa72-117d-4b21-9ab2-ba72496716f6 req-af40227b-ea16-4cdf-a2d9-e22d848afdb9 service nova] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-6a29fa72-117d-4b21-9ab2-ba72496716f6 req-af40227b-ea16-4cdf-a2d9-e22d848afdb9 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] No waiting events found dispatching network-vif-unplugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-6a29fa72-117d-4b21-9ab2-ba72496716f6 req-af40227b-ea16-4cdf-a2d9-e22d848afdb9 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received event network-vif-unplugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Instance destroyed successfully.
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'resources' on Instance uuid 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-520088867',display_name='tempest-AttachVolumeNegativeTest-server-520088867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-520088867',id=29,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdOj4gakdXMZ4TFiXY6uyRoO1RJG8Ldg5zEm7Im72HlwRhdxbGuPmJhGWpIKwAlGO2px7JBYHEPg4PpHrkItXaytNMnaJ7Am6+oFYLru4c8F5SAU9i833F6FQXOPZVfnw==',key_name='tempest-keypair-1527861399',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-mvuj0qmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:42:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=43a0ee0f-c3ce-438d-84be-e9eaf19f5e37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "address": "fa:16:3e:28:b6:44", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c773def-22", "ovs_interfaceid": "4c773def-22ad-458a-8eb1-6f3b86e495f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b6:44,bridge_name='br-int',has_traffic_filtering=True,id=4c773def-22ad-458a-8eb1-6f3b86e495f0,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c773def-22') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG os_vif [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b6:44,bridge_name='br-int',has_traffic_filtering=True,id=4c773def-22ad-458a-8eb1-6f3b86e495f0,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c773def-22') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c773def-22, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2873aa0a-e574-41b7-9c78-862a5a6978e3) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:43:59 user nova-compute[75215]: INFO os_vif [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b6:44,bridge_name='br-int',has_traffic_filtering=True,id=4c773def-22ad-458a-8eb1-6f3b86e495f0,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c773def-22')
Nov 11 01:43:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Deleting instance files /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37_del
Nov 11 01:43:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Deletion of /opt/stack/data/nova/instances/43a0ee0f-c3ce-438d-84be-e9eaf19f5e37_del complete
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:43:59 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:43:59 user nova-compute[75215]: INFO nova.compute.manager [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 11 01:43:59 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:44:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.policy [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d021b68204c4fec98a56ec87b8e7d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b408f431cc5b40f39c3e77cb9b625550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:44:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Creating image(s)
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "/opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "/opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.314s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk 1073741824" returned: 0 in 0.062s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Cannot resize image /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Ensure instance console log exists: /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:44:01 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Took 1.48 seconds to deallocate network for instance.
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-c264cd62-a172-42f3-b810-a0d45376df63 req-444b59e6-3243-46fe-b3b3-5836fa652319 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received event network-vif-deleted-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:01 user nova-compute[75215]: INFO nova.compute.manager [req-c264cd62-a172-42f3-b810-a0d45376df63 req-444b59e6-3243-46fe-b3b3-5836fa652319 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Neutron deleted interface 4c773def-22ad-458a-8eb1-6f3b86e495f0; detaching it from the instance and deleting it from the info cache
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-c264cd62-a172-42f3-b810-a0d45376df63 req-444b59e6-3243-46fe-b3b3-5836fa652319 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-c264cd62-a172-42f3-b810-a0d45376df63 req-444b59e6-3243-46fe-b3b3-5836fa652319 service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Detach interface failed, port_id=4c773def-22ad-458a-8eb1-6f3b86e495f0, reason: Instance 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-92083002-5d6a-4634-a85d-9162e0248085 req-02247a87-1924-4072-803d-8728ebfabd0a service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received event network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-92083002-5d6a-4634-a85d-9162e0248085 req-02247a87-1924-4072-803d-8728ebfabd0a service nova] Acquiring lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-92083002-5d6a-4634-a85d-9162e0248085 req-02247a87-1924-4072-803d-8728ebfabd0a service nova] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-92083002-5d6a-4634-a85d-9162e0248085 req-02247a87-1924-4072-803d-8728ebfabd0a service nova] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-92083002-5d6a-4634-a85d-9162e0248085 req-02247a87-1924-4072-803d-8728ebfabd0a service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] No waiting events found dispatching network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:01 user nova-compute[75215]: WARNING nova.compute.manager [req-92083002-5d6a-4634-a85d-9162e0248085 req-02247a87-1924-4072-803d-8728ebfabd0a service nova] [instance: 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37] Received unexpected event network-vif-plugged-4c773def-22ad-458a-8eb1-6f3b86e495f0 for instance with vm_state active and task_state deleting.
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Successfully created port: ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:44:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:02 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Deleted allocations for instance 43a0ee0f-c3ce-438d-84be-e9eaf19f5e37
Nov 11 01:44:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2ed843b9-2e95-4770-b145-36fa2618c6d1 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "43a0ee0f-c3ce-438d-84be-e9eaf19f5e37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.178s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Successfully updated port: ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquired lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-308bce18-5805-4e70-8a44-49e1808fe319 req-a8f0ced1-e7ef-463d-8cd6-19edaec64a4b service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received event network-changed-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-308bce18-5805-4e70-8a44-49e1808fe319 req-a8f0ced1-e7ef-463d-8cd6-19edaec64a4b service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Refreshing instance network info cache due to event network-changed-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-308bce18-5805-4e70-8a44-49e1808fe319 req-a8f0ced1-e7ef-463d-8cd6-19edaec64a4b service nova] Acquiring lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating instance_info_cache with network_info: [{"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Releasing lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Instance network_info: |[{"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-308bce18-5805-4e70-8a44-49e1808fe319 req-a8f0ced1-e7ef-463d-8cd6-19edaec64a4b service nova] Acquired lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-308bce18-5805-4e70-8a44-49e1808fe319 req-a8f0ced1-e7ef-463d-8cd6-19edaec64a4b service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Refreshing network info cache for port ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Start _get_guest_xml network_info=[{"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:44:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1614537940',display_name='tempest-SnapshotDataIntegrityTests-server-1614537940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1614537940',id=30,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN+eJkXS2PypHTPUXSBiSodfTAAuKBII/zDjHioRSePTFvb45jcHpnjZ86URjMMAYOdLuXvRIp95tMrdaviZuIQV95mzyIFPh59DaBagBdfXxjd+KiNDHduHZ3CZVb/QQ==',key_name='tempest-keypair-1426602419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b408f431cc5b40f39c3e77cb9b625550',ramdisk_id='',reservation_id='r-5cp6s9yf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1286994852',owner_user_name='tempest-SnapshotDataIntegrityTests-1286994852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d021b68204c4fec98a56ec87b8e7d1d',uuid=ff69af94-7f3b-4851-a36b-a351fe838c66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Converting VIF {"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:42:0d,bridge_name='br-int',has_traffic_filtering=True,id=ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2,network=Network(a4a0185c-f23a-4976-a021-3b35017fc71c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47b2f0-69') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'pci_devices' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:44:02 user nova-compute[75215]:   <uuid>ff69af94-7f3b-4851-a36b-a351fe838c66</uuid>
Nov 11 01:44:02 user nova-compute[75215]:   <name>instance-0000001e</name>
Nov 11 01:44:02 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:44:02 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:44:02 user nova-compute[75215]:   <metadata>
Nov 11 01:44:02 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:44:02 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:44:02 user nova-compute[75215]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1614537940</nova:name>
Nov 11 01:44:02 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:44:02</nova:creationTime>
Nov 11 01:44:02 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:44:02 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:44:02 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:44:02 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:44:02 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:44:02 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:44:02 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:44:02 user nova-compute[75215]:       <nova:owner>
Nov 11 01:44:02 user nova-compute[75215]:         <nova:user uuid="7d021b68204c4fec98a56ec87b8e7d1d">tempest-SnapshotDataIntegrityTests-1286994852-project-member</nova:user>
Nov 11 01:44:02 user nova-compute[75215]:         <nova:project uuid="b408f431cc5b40f39c3e77cb9b625550">tempest-SnapshotDataIntegrityTests-1286994852</nova:project>
Nov 11 01:44:02 user nova-compute[75215]:       </nova:owner>
Nov 11 01:44:02 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:44:02 user nova-compute[75215]:       <nova:ports>
Nov 11 01:44:02 user nova-compute[75215]:         <nova:port uuid="ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2">
Nov 11 01:44:02 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:44:02 user nova-compute[75215]:         </nova:port>
Nov 11 01:44:02 user nova-compute[75215]:       </nova:ports>
Nov 11 01:44:02 user nova-compute[75215]:     </nova:instance>
Nov 11 01:44:02 user nova-compute[75215]:   </metadata>
Nov 11 01:44:02 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:44:02 user nova-compute[75215]:     <system>
Nov 11 01:44:02 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:44:02 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:44:02 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:44:02 user nova-compute[75215]:       <entry name="serial">ff69af94-7f3b-4851-a36b-a351fe838c66</entry>
Nov 11 01:44:02 user nova-compute[75215]:       <entry name="uuid">ff69af94-7f3b-4851-a36b-a351fe838c66</entry>
Nov 11 01:44:02 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:44:02 user nova-compute[75215]:     </system>
Nov 11 01:44:02 user nova-compute[75215]:   </sysinfo>
Nov 11 01:44:02 user nova-compute[75215]:   <os>
Nov 11 01:44:02 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:44:02 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:44:02 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:44:02 user nova-compute[75215]:   </os>
Nov 11 01:44:02 user nova-compute[75215]:   <features>
Nov 11 01:44:02 user nova-compute[75215]:     <acpi/>
Nov 11 01:44:02 user nova-compute[75215]:     <apic/>
Nov 11 01:44:02 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:44:02 user nova-compute[75215]:   </features>
Nov 11 01:44:02 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:44:02 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:44:02 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:44:02 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:44:02 user nova-compute[75215]:   </clock>
Nov 11 01:44:02 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:44:02 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:44:02 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:44:02 user nova-compute[75215]:   </cpu>
Nov 11 01:44:02 user nova-compute[75215]:   <devices>
Nov 11 01:44:02 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:44:02 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:44:02 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk"/>
Nov 11 01:44:02 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:44:02 user nova-compute[75215]:     </disk>
Nov 11 01:44:02 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:44:02 user nova-compute[75215]:       <mac address="fa:16:3e:fc:42:0d"/>
Nov 11 01:44:02 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:44:02 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:44:02 user nova-compute[75215]:       <target dev="tapef47b2f0-69"/>
Nov 11 01:44:02 user nova-compute[75215]:     </interface>
Nov 11 01:44:02 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:44:02 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/console.log" append="off"/>
Nov 11 01:44:02 user nova-compute[75215]:     </serial>
Nov 11 01:44:02 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:44:02 user nova-compute[75215]:     <video>
Nov 11 01:44:02 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:44:02 user nova-compute[75215]:     </video>
Nov 11 01:44:02 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:44:02 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:44:02 user nova-compute[75215]:     </rng>
Nov 11 01:44:02 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:44:02 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:44:02 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:44:02 user nova-compute[75215]:     </memballoon>
Nov 11 01:44:02 user nova-compute[75215]:   </devices>
Nov 11 01:44:02 user nova-compute[75215]: </domain>
Nov 11 01:44:02 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1614537940',display_name='tempest-SnapshotDataIntegrityTests-server-1614537940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1614537940',id=30,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN+eJkXS2PypHTPUXSBiSodfTAAuKBII/zDjHioRSePTFvb45jcHpnjZ86URjMMAYOdLuXvRIp95tMrdaviZuIQV95mzyIFPh59DaBagBdfXxjd+KiNDHduHZ3CZVb/QQ==',key_name='tempest-keypair-1426602419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b408f431cc5b40f39c3e77cb9b625550',ramdisk_id='',reservation_id='r-5cp6s9yf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1286994852',owner_user_name='tempest-SnapshotDataIntegrityTests-1286994852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d021b68204c4fec98a56ec87b8e7d1d',uuid=ff69af94-7f3b-4851-a36b-a351fe838c66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Converting VIF {"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:42:0d,bridge_name='br-int',has_traffic_filtering=True,id=ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2,network=Network(a4a0185c-f23a-4976-a021-3b35017fc71c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47b2f0-69') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG os_vif [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:42:0d,bridge_name='br-int',has_traffic_filtering=True,id=ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2,network=Network(a4a0185c-f23a-4976-a021-3b35017fc71c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47b2f0-69') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd68bde2b-f5b6-50a4-a489-d3409045f857', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef47b2f0-69, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef47b2f0-69, col_values=(('qos', UUID('73fc7d8f-35f1-455c-9d39-d08eb0c24568')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef47b2f0-69, col_values=(('external_ids', {'iface-id': 'ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:42:0d', 'vm-uuid': 'ff69af94-7f3b-4851-a36b-a351fe838c66'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:02 user nova-compute[75215]: INFO os_vif [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:42:0d,bridge_name='br-int',has_traffic_filtering=True,id=ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2,network=Network(a4a0185c-f23a-4976-a021-3b35017fc71c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47b2f0-69')
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:44:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No VIF found with MAC fa:16:3e:fc:42:0d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:44:03 user nova-compute[75215]: DEBUG nova.network.neutron [req-308bce18-5805-4e70-8a44-49e1808fe319 req-a8f0ced1-e7ef-463d-8cd6-19edaec64a4b service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updated VIF entry in instance network info cache for port ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:44:03 user nova-compute[75215]: DEBUG nova.network.neutron [req-308bce18-5805-4e70-8a44-49e1808fe319 req-a8f0ced1-e7ef-463d-8cd6-19edaec64a4b service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating instance_info_cache with network_info: [{"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:44:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-308bce18-5805-4e70-8a44-49e1808fe319 req-a8f0ced1-e7ef-463d-8cd6-19edaec64a4b service nova] Releasing lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:44:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-8bb8945a-dcaf-4986-be1d-78618e6363a4 req-b5527afe-7380-43e7-bbde-24ecf29e209c service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received event network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8bb8945a-dcaf-4986-be1d-78618e6363a4 req-b5527afe-7380-43e7-bbde-24ecf29e209c service nova] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8bb8945a-dcaf-4986-be1d-78618e6363a4 req-b5527afe-7380-43e7-bbde-24ecf29e209c service nova] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8bb8945a-dcaf-4986-be1d-78618e6363a4 req-b5527afe-7380-43e7-bbde-24ecf29e209c service nova] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-8bb8945a-dcaf-4986-be1d-78618e6363a4 req-b5527afe-7380-43e7-bbde-24ecf29e209c service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] No waiting events found dispatching network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:04 user nova-compute[75215]: WARNING nova.compute.manager [req-8bb8945a-dcaf-4986-be1d-78618e6363a4 req-b5527afe-7380-43e7-bbde-24ecf29e209c service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received unexpected event network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 for instance with vm_state building and task_state spawning.
Nov 11 01:44:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-5b1e9be4-fa47-43af-b750-60314ac4c75b req-5a0a2bf4-0049-4d78-961d-1b862c0f4cb5 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received event network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b1e9be4-fa47-43af-b750-60314ac4c75b req-5a0a2bf4-0049-4d78-961d-1b862c0f4cb5 service nova] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b1e9be4-fa47-43af-b750-60314ac4c75b req-5a0a2bf4-0049-4d78-961d-1b862c0f4cb5 service nova] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b1e9be4-fa47-43af-b750-60314ac4c75b req-5a0a2bf4-0049-4d78-961d-1b862c0f4cb5 service nova] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-5b1e9be4-fa47-43af-b750-60314ac4c75b req-5a0a2bf4-0049-4d78-961d-1b862c0f4cb5 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] No waiting events found dispatching network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:06 user nova-compute[75215]: WARNING nova.compute.manager [req-5b1e9be4-fa47-43af-b750-60314ac4c75b req-5a0a2bf4-0049-4d78-961d-1b862c0f4cb5 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received unexpected event network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 for instance with vm_state building and task_state spawning.
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:44:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Instance spawned successfully.
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:06 user nova-compute[75215]: INFO nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 11 01:44:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:44:07 user nova-compute[75215]: INFO nova.compute.manager [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Took 7.72 seconds to build instance.
Nov 11 01:44:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bcd77bfd-3bdd-4921-b25f-8fa0b603f650 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.852s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Starting finish_migration {{(pid=75215) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 01:44:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Creating image(s)
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Ensure instance console log exists: /opt/stack/data/nova/instances/298c4f12-029f-407a-a71f-d5c722655f8d/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Start _get_guest_xml network_info=[{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1630024766-network", "vif_mac": "fa:16:3e:7c:37:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '819b09ee-d4e3-4832-b58b-1ff36422a02b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGOIeEap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '298c4f12-029f-407a-a71f-d5c722655f8d', 'attached_at': '2023-11-11T01:44:09.000000', 'detached_at': '', 'volume_id': '42983526-ca9e-4973-8891-7830b5f2fc1e', 'serial': '42983526-ca9e-4973-8891-7830b5f2fc1e'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:44:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:09 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGOIeEap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:44:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:44:09 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:44:09 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeb31e6-389c-4a7e-9542-ecca6af65593]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:44:09 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b78efd-270e-463f-84fc-09c09fc89627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e] added
Nov 11 01:44:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[91596c4e-d64e-42ab-bad6-bba111cb92cd]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cffc987-a31b-4185-9ada-e2540a9c072a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGOIeEap {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGOIeEap" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afe903-4ecc-4716-9b1a-0772bd953735]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TGOIeEap'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f0b1d2-c6eb-45fb-8834-02fc73f1b88b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea835bb2-da31-4ce5-8b93-b35431164587]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[514d66d9-fe3e-47e2-906b-34a66273f2c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260]
Nov 11 01:44:09 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260] successful.
Nov 11 01:44:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0b546-0132-4353-a80b-48ea30df6186]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb71bf5-2e41-42c1-be6a-417e39783380]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:44:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:09 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:44:09 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b644646-1581-4279-8c22-c149736f9846]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:44:09 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGOIeEap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26338323931383036', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338323931383036', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538928176',display_name='tempest-ServerActionsTestOtherA-server-538928176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538928176',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-tlmg4me0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=298c4f12-029f-407a-a71f-d5c722655f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1630024766-network", "vif_mac": "fa:16:3e:7c:37:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1630024766-network", "vif_mac": "fa:16:3e:7c:37:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:44:10 user nova-compute[75215]:   <uuid>298c4f12-029f-407a-a71f-d5c722655f8d</uuid>
Nov 11 01:44:10 user nova-compute[75215]:   <name>instance-0000001a</name>
Nov 11 01:44:10 user nova-compute[75215]:   <memory>2097152</memory>
Nov 11 01:44:10 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:44:10 user nova-compute[75215]:   <metadata>
Nov 11 01:44:10 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:44:10 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:44:10 user nova-compute[75215]:       <nova:name>tempest-ServerActionsTestOtherA-server-538928176</nova:name>
Nov 11 01:44:10 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:44:09</nova:creationTime>
Nov 11 01:44:10 user nova-compute[75215]:       <nova:flavor name="m1.small">
Nov 11 01:44:10 user nova-compute[75215]:         <nova:memory>2048</nova:memory>
Nov 11 01:44:10 user nova-compute[75215]:         <nova:disk>20</nova:disk>
Nov 11 01:44:10 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:44:10 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:44:10 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:44:10 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:44:10 user nova-compute[75215]:       <nova:owner>
Nov 11 01:44:10 user nova-compute[75215]:         <nova:user uuid="44e25bace5db43638b4eedfeb9215e24">tempest-ServerActionsTestOtherA-802983068-project-member</nova:user>
Nov 11 01:44:10 user nova-compute[75215]:         <nova:project uuid="c6fb80bd889f488bbfa25060dca25bb8">tempest-ServerActionsTestOtherA-802983068</nova:project>
Nov 11 01:44:10 user nova-compute[75215]:       </nova:owner>
Nov 11 01:44:10 user nova-compute[75215]:       <nova:ports>
Nov 11 01:44:10 user nova-compute[75215]:         <nova:port uuid="404153aa-e572-4f64-a3c7-c474c6811610">
Nov 11 01:44:10 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 11 01:44:10 user nova-compute[75215]:         </nova:port>
Nov 11 01:44:10 user nova-compute[75215]:       </nova:ports>
Nov 11 01:44:10 user nova-compute[75215]:     </nova:instance>
Nov 11 01:44:10 user nova-compute[75215]:   </metadata>
Nov 11 01:44:10 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:44:10 user nova-compute[75215]:     <system>
Nov 11 01:44:10 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:44:10 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:44:10 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:44:10 user nova-compute[75215]:       <entry name="serial">298c4f12-029f-407a-a71f-d5c722655f8d</entry>
Nov 11 01:44:10 user nova-compute[75215]:       <entry name="uuid">298c4f12-029f-407a-a71f-d5c722655f8d</entry>
Nov 11 01:44:10 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:44:10 user nova-compute[75215]:     </system>
Nov 11 01:44:10 user nova-compute[75215]:   </sysinfo>
Nov 11 01:44:10 user nova-compute[75215]:   <os>
Nov 11 01:44:10 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:44:10 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:44:10 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:44:10 user nova-compute[75215]:   </os>
Nov 11 01:44:10 user nova-compute[75215]:   <features>
Nov 11 01:44:10 user nova-compute[75215]:     <acpi/>
Nov 11 01:44:10 user nova-compute[75215]:     <apic/>
Nov 11 01:44:10 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:44:10 user nova-compute[75215]:   </features>
Nov 11 01:44:10 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:44:10 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:44:10 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:44:10 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:44:10 user nova-compute[75215]:   </clock>
Nov 11 01:44:10 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:44:10 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:44:10 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:44:10 user nova-compute[75215]:   </cpu>
Nov 11 01:44:10 user nova-compute[75215]:   <devices>
Nov 11 01:44:10 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:44:10 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:44:10 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 11 01:44:10 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:44:10 user nova-compute[75215]:       <serial>42983526-ca9e-4973-8891-7830b5f2fc1e</serial>
Nov 11 01:44:10 user nova-compute[75215]:     </disk>
Nov 11 01:44:10 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:44:10 user nova-compute[75215]:       <mac address="fa:16:3e:7c:37:65"/>
Nov 11 01:44:10 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:44:10 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:44:10 user nova-compute[75215]:       <target dev="tap404153aa-e5"/>
Nov 11 01:44:10 user nova-compute[75215]:     </interface>
Nov 11 01:44:10 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:44:10 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/298c4f12-029f-407a-a71f-d5c722655f8d/console.log" append="off"/>
Nov 11 01:44:10 user nova-compute[75215]:     </serial>
Nov 11 01:44:10 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:44:10 user nova-compute[75215]:     <video>
Nov 11 01:44:10 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:44:10 user nova-compute[75215]:     </video>
Nov 11 01:44:10 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:44:10 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:44:10 user nova-compute[75215]:     </rng>
Nov 11 01:44:10 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:44:10 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:44:10 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:44:10 user nova-compute[75215]:     </memballoon>
Nov 11 01:44:10 user nova-compute[75215]:   </devices>
Nov 11 01:44:10 user nova-compute[75215]: </domain>
Nov 11 01:44:10 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538928176',display_name='tempest-ServerActionsTestOtherA-server-538928176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538928176',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-tlmg4me0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=298c4f12-029f-407a-a71f-d5c722655f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1630024766-network", "vif_mac": "fa:16:3e:7c:37:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1630024766-network", "vif_mac": "fa:16:3e:7c:37:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG os_vif [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'defcfe6f-ffa4-5a42-8da1-825e48398e91', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap404153aa-e5, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap404153aa-e5, col_values=(('qos', UUID('5a6337ce-e0e5-4270-9fa3-95630829a4c0')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap404153aa-e5, col_values=(('external_ids', {'iface-id': '404153aa-e572-4f64-a3c7-c474c6811610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:37:65', 'vm-uuid': '298c4f12-029f-407a-a71f-d5c722655f8d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:10 user nova-compute[75215]: INFO os_vif [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5')
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:44:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] No VIF found with MAC fa:16:3e:7c:37:65, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-bce1a957-3227-489f-912e-637cdd7abe02 req-96038bfd-93ad-4083-96c2-cde1ef585882 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bce1a957-3227-489f-912e-637cdd7abe02 req-96038bfd-93ad-4083-96c2-cde1ef585882 service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bce1a957-3227-489f-912e-637cdd7abe02 req-96038bfd-93ad-4083-96c2-cde1ef585882 service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bce1a957-3227-489f-912e-637cdd7abe02 req-96038bfd-93ad-4083-96c2-cde1ef585882 service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-bce1a957-3227-489f-912e-637cdd7abe02 req-96038bfd-93ad-4083-96c2-cde1ef585882 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:12 user nova-compute[75215]: WARNING nova.compute.manager [req-bce1a957-3227-489f-912e-637cdd7abe02 req-96038bfd-93ad-4083-96c2-cde1ef585882 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state active and task_state resize_finish.
Nov 11 01:44:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:44:14 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance running successfully.
Nov 11 01:44:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Failed to set time: agent not configured {{(pid=75215) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 11 01:44:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-91d37394-4fb6-4713-9cc7-4f85b968355d tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] finish_migration finished successfully. {{(pid=75215) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 11 01:44:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-d138cb37-16ca-4f13-9159-3e53216229f7 req-28a460f4-3cf9-40f3-b58d-ea4238064724 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d138cb37-16ca-4f13-9159-3e53216229f7 req-28a460f4-3cf9-40f3-b58d-ea4238064724 service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d138cb37-16ca-4f13-9159-3e53216229f7 req-28a460f4-3cf9-40f3-b58d-ea4238064724 service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d138cb37-16ca-4f13-9159-3e53216229f7 req-28a460f4-3cf9-40f3-b58d-ea4238064724 service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-d138cb37-16ca-4f13-9159-3e53216229f7 req-28a460f4-3cf9-40f3-b58d-ea4238064724 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:15 user nova-compute[75215]: WARNING nova.compute.manager [req-d138cb37-16ca-4f13-9159-3e53216229f7 req-28a460f4-3cf9-40f3-b58d-ea4238064724 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state resized and task_state None.
Nov 11 01:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:44:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:44:24 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:24 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7411MB free_disk=25.18048095703125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Applying migration context for instance 298c4f12-029f-407a-a71f-d5c722655f8d as it has an incoming, in-progress migration ad65b427-adac-4d1d-b712-840ca87f0c9d. Migration status is finished {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 11 01:44:24 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating resource usage from migration ad65b427-adac-4d1d-b712-840ca87f0c9d
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 323cc88a-b1b3-4a44-9674-818ba3e317f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Migration ad65b427-adac-4d1d-b712-840ca87f0c9d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 298c4f12-029f-407a-a71f-d5c722655f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:44:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:44:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:44:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:44:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updating instance_info_cache with network_info: [{"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-b372f84a-390e-4707-ad3c-8d9f0a7c8327" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:44:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:30 user nova-compute[75215]: INFO nova.compute.manager [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Rescuing
Nov 11 01:44:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:44:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquired lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:44:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Updating instance_info_cache with network_info: [{"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Releasing lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-136e1b2c-c328-4995-aa42-dbe54d303dc3 req-d435a722-2da1-4c76-9572-6c0ff851bd4e service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-136e1b2c-c328-4995-aa42-dbe54d303dc3 req-d435a722-2da1-4c76-9572-6c0ff851bd4e service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-136e1b2c-c328-4995-aa42-dbe54d303dc3 req-d435a722-2da1-4c76-9572-6c0ff851bd4e service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-136e1b2c-c328-4995-aa42-dbe54d303dc3 req-d435a722-2da1-4c76-9572-6c0ff851bd4e service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG nova.compute.manager [req-136e1b2c-c328-4995-aa42-dbe54d303dc3 req-d435a722-2da1-4c76-9572-6c0ff851bd4e service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:31 user nova-compute[75215]: WARNING nova.compute.manager [req-136e1b2c-c328-4995-aa42-dbe54d303dc3 req-d435a722-2da1-4c76-9572-6c0ff851bd4e service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state active and task_state rescuing.
Nov 11 01:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance destroyed successfully.
Nov 11 01:44:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Attempting a stable device rescue
Nov 11 01:44:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 01:44:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 01:44:32 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Creating image(s)
Nov 11 01:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "/opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "/opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:32 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "4df477c70017a78c314ca5eea4019b1447c2c432" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "4df477c70017a78c314ca5eea4019b1447c2c432" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG nova.virt.images [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] 39b7aa53-b015-4161-81b2-ed56f6a90f4f was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432.part /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-f8ff7714-bfb6-4ba1-a04e-eaea9d8e19eb req-691d632c-f1f1-403f-825d-e9ef5e3a4ab6 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f8ff7714-bfb6-4ba1-a04e-eaea9d8e19eb req-691d632c-f1f1-403f-825d-e9ef5e3a4ab6 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f8ff7714-bfb6-4ba1-a04e-eaea9d8e19eb req-691d632c-f1f1-403f-825d-e9ef5e3a4ab6 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f8ff7714-bfb6-4ba1-a04e-eaea9d8e19eb req-691d632c-f1f1-403f-825d-e9ef5e3a4ab6 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-f8ff7714-bfb6-4ba1-a04e-eaea9d8e19eb req-691d632c-f1f1-403f-825d-e9ef5e3a4ab6 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:33 user nova-compute[75215]: WARNING nova.compute.manager [req-f8ff7714-bfb6-4ba1-a04e-eaea9d8e19eb req-691d632c-f1f1-403f-825d-e9ef5e3a4ab6 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state active and task_state rescuing.
Nov 11 01:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432.part /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432.converted" returned: 0 in 0.325s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "4df477c70017a78c314ca5eea4019b1447c2c432" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.863s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "4df477c70017a78c314ca5eea4019b1447c2c432" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "4df477c70017a78c314ca5eea4019b1447c2c432" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432 --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432,backing_fmt=raw /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432,backing_fmt=raw /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.rescue" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "4df477c70017a78c314ca5eea4019b1447c2c432" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'migration_context' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<7ac25219-b9e6-4698-b6e4-1d6c5653cfc9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Start _get_guest_xml network_info=[{"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "vif_mac": "fa:16:3e:e5:e7:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '39b7aa53-b015-4161-81b2-ed56f6a90f4f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '10563d73-a6e8-48bb-87e1-27427da511ae', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJMBxgLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7ac25219-b9e6-4698-b6e4-1d6c5653cfc9', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'serial': 'fa1398e5-6ecf-4aae-9962-62ad0736ade9'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'resources' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<7ac25219-b9e6-4698-b6e4-1d6c5653cfc9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<7ac25219-b9e6-4698-b6e4-1d6c5653cfc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:44:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:34 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<7ac25219-b9e6-4698-b6e4-1d6c5653cfc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJMBxgLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:44:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:44:34 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:44:34 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f1e76-edb5-4811-b981-dff254a049db]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lJMBxgLY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 11 01:44:34 user nova-compute[75215]: node.name = iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9
Nov 11 01:44:34 user nova-compute[75215]: node.tpgt = -1
Nov 11 01:44:34 user nova-compute[75215]: node.startup = automatic
Nov 11 01:44:34 user nova-compute[75215]: node.leading_login = No
Nov 11 01:44:34 user nova-compute[75215]: iface.iscsi_ifacename = default
Nov 11 01:44:34 user nova-compute[75215]: iface.net_ifacename = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.ipaddress = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.prefix_len = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.hwaddress = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.transport_name = tcp
Nov 11 01:44:34 user nova-compute[75215]: iface.initiatorname = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.state = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.vlan_id = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.vlan_priority = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.vlan_state = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.iface_num = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.mtu = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.port = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.bootproto = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.subnet_mask = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.gateway = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.dhcp_alt_client_id_state = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.dhcp_alt_client_id = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.dhcp_dns = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.dhcp_learn_iqn = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.dhcp_req_vendor_id_state = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.dhcp_vendor_id_state = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.dhcp_vendor_id = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.dhcp_slp_da = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.fragmentation = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.gratuitous_arp = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.incoming_forwarding = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.tos_state = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.tos = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.ttl = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.delayed_ack = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.tcp_nagle = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.tcp_wsf_state = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.tcp_wsf = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.tcp_timer_scale = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.tcp_timestamp = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.redirect = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.def_task_mgmt_timeout = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.header_digest = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.data_digest = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.immediate_data = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.initial_r2t = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.data_seq_inorder = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.data_pdu_inorder = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.erl = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.max_receive_data_len = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.first_burst_len = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.max_outstanding_r2t = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.max_burst_len = 0
Nov 11 01:44:34 user nova-compute[75215]: iface.chap_auth = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.bidi_chap = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.strict_login_compliance = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.discovery_auth = <empty>
Nov 11 01:44:34 user nova-compute[75215]: iface.discovery_logout = <empty>
Nov 11 01:44:34 user nova-compute[75215]: node.discovery_address = <empty>
Nov 11 01:44:34 user nova-compute[75215]: node.discovery_port = 0
Nov 11 01:44:34 user nova-compute[75215]: node.discovery_type = static
Nov 11 01:44:34 user nova-compute[75215]: node.session.initial_cmdsn = 0
Nov 11 01:44:34 user nova-compute[75215]: node.session.initial_login_retry_max = 8
Nov 11 01:44:34 user nova-compute[75215]: node.session.xmit_thread_priority = -20
Nov 11 01:44:34 user nova-compute[75215]: node.session.cmds_max = 128
Nov 11 01:44:34 user nova-compute[75215]: node.session.queue_depth = 32
Nov 11 01:44:34 user nova-compute[75215]: node.session.nr_sessions = 1
Nov 11 01:44:34 user nova-compute[75215]: node.session.auth.authmethod = CHAP
Nov 11 01:44:34 user nova-compute[75215]: node.session.auth.username = lJMBxgLY
Nov 11 01:44:34 user nova-compute[75215]: node.session.auth.password = ***
Nov 11 01:44:34 user nova-compute[75215]: node.session.auth.username_in = <empty>
Nov 11 01:44:34 user nova-compute[75215]: node.session.auth.password_in = <empty>
Nov 11 01:44:34 user nova-compute[75215]: node.session.auth.chap_algs = MD5
Nov 11 01:44:34 user nova-compute[75215]: node.session.timeo.replacement_timeout = 120
Nov 11 01:44:34 user nova-compute[75215]: node.session.err_timeo.abort_timeout = 15
Nov 11 01:44:34 user nova-compute[75215]: node.session.err_timeo.lu_reset_timeout = 30
Nov 11 01:44:34 user nova-compute[75215]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 11 01:44:34 user nova-compute[75215]: node.session.err_timeo.host_reset_timeout = 60
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.FastAbort = Yes
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.InitialR2T = No
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.ImmediateData = Yes
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.FirstBurstLength = 262144
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.MaxBurstLength = 16776192
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.DefaultTime2Retain = 0
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.DefaultTime2Wait = 2
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.MaxConnections = 1
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 11 01:44:34 user nova-compute[75215]: node.session.iscsi.ERL = 0
Nov 11 01:44:34 user nova-compute[75215]: node.session.scan = manual
Nov 11 01:44:34 user nova-compute[75215]: node.session.reopen_max = 0
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].address = 172.16.0.220
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].port = 3260
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].startup = manual
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].tcp.window_size = 524288
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].tcp.type_of_service = 0
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].timeo.logout_timeout = 15
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].timeo.login_timeout = 15
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].timeo.auth_timeout = 45
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].timeo.noop_out_interval = 5
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].timeo.noop_out_timeout = 5
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].iscsi.HeaderDigest = None
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].iscsi.DataDigest = None
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].iscsi.IFMarker = No
Nov 11 01:44:34 user nova-compute[75215]: node.conn[0].iscsi.OFMarker = No
Nov 11 01:44:34 user nova-compute[75215]: # END RECORD
Nov 11 01:44:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0229d08d-8caa-4a9b-9304-9642c3f9edb6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b5ac1-c8e7-419a-9e37-b0c1c62eda73]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJMBxgLY {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJMBxgLY" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbfd0bb-a572-43a2-bbe2-66d9b584e1cf]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJMBxgLY'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e0356e-f705-4fe9-8b96-ae9540b6df98]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff90d97b-c067-4638-a272-deb887c325a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:34 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:34 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:34 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:44:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:34 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:34 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:34 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:44:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] HCTL ('34', '0', '0', 0) found on session 24 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[480aba3c-6f9d-4cfb-ab2f-2eafe5ee36e2]: (4, ('0 0 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Searching for a device in session 24 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJMBxgLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '23066616562386236', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066616562386236', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1717157221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1717157221',id=27,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-oc54hq59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:43:10Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=7ac25219-b9e6-4698-b6e4-1d6c5653cfc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "vif_mac": "fa:16:3e:e5:e7:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "vif_mac": "fa:16:3e:e5:e7:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e7:25,bridge_name='br-int',has_traffic_filtering=True,id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fc7525-cd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.objects.base [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Object Instance<7ac25219-b9e6-4698-b6e4-1d6c5653cfc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:44:34 user nova-compute[75215]:   <uuid>7ac25219-b9e6-4698-b6e4-1d6c5653cfc9</uuid>
Nov 11 01:44:34 user nova-compute[75215]:   <name>instance-0000001b</name>
Nov 11 01:44:34 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:44:34 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:44:34 user nova-compute[75215]:   <metadata>
Nov 11 01:44:34 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:44:34 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:44:34 user nova-compute[75215]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1717157221</nova:name>
Nov 11 01:44:34 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:44:34</nova:creationTime>
Nov 11 01:44:34 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:44:34 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:44:34 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:44:34 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:44:34 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:44:34 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:44:34 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:44:34 user nova-compute[75215]:       <nova:owner>
Nov 11 01:44:34 user nova-compute[75215]:         <nova:user uuid="561ad55121d44be1ab7971a495b9347f">tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member</nova:user>
Nov 11 01:44:34 user nova-compute[75215]:         <nova:project uuid="32564a70b861419eaefcb97cd327088d">tempest-ServerBootFromVolumeStableRescueTest-1327607516</nova:project>
Nov 11 01:44:34 user nova-compute[75215]:       </nova:owner>
Nov 11 01:44:34 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:44:34 user nova-compute[75215]:       <nova:ports>
Nov 11 01:44:34 user nova-compute[75215]:         <nova:port uuid="79fc7525-cd86-430b-a28f-40f2e0e6c0fe">
Nov 11 01:44:34 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:44:34 user nova-compute[75215]:         </nova:port>
Nov 11 01:44:34 user nova-compute[75215]:       </nova:ports>
Nov 11 01:44:34 user nova-compute[75215]:     </nova:instance>
Nov 11 01:44:34 user nova-compute[75215]:   </metadata>
Nov 11 01:44:34 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:44:34 user nova-compute[75215]:     <system>
Nov 11 01:44:34 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:44:34 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:44:34 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:44:34 user nova-compute[75215]:       <entry name="serial">7ac25219-b9e6-4698-b6e4-1d6c5653cfc9</entry>
Nov 11 01:44:34 user nova-compute[75215]:       <entry name="uuid">7ac25219-b9e6-4698-b6e4-1d6c5653cfc9</entry>
Nov 11 01:44:34 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:44:34 user nova-compute[75215]:     </system>
Nov 11 01:44:34 user nova-compute[75215]:   </sysinfo>
Nov 11 01:44:34 user nova-compute[75215]:   <os>
Nov 11 01:44:34 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:44:34 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:44:34 user nova-compute[75215]:   </os>
Nov 11 01:44:34 user nova-compute[75215]:   <features>
Nov 11 01:44:34 user nova-compute[75215]:     <acpi/>
Nov 11 01:44:34 user nova-compute[75215]:     <apic/>
Nov 11 01:44:34 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:44:34 user nova-compute[75215]:   </features>
Nov 11 01:44:34 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:44:34 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:44:34 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:44:34 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:44:34 user nova-compute[75215]:   </clock>
Nov 11 01:44:34 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:44:34 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:44:34 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:44:34 user nova-compute[75215]:   </cpu>
Nov 11 01:44:34 user nova-compute[75215]:   <devices>
Nov 11 01:44:34 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:44:34 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:44:34 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 11 01:44:34 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:44:34 user nova-compute[75215]:       <serial>fa1398e5-6ecf-4aae-9962-62ad0736ade9</serial>
Nov 11 01:44:34 user nova-compute[75215]:     </disk>
Nov 11 01:44:34 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:44:34 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:44:34 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.rescue"/>
Nov 11 01:44:34 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:44:34 user nova-compute[75215]:       <boot order="1"/>
Nov 11 01:44:34 user nova-compute[75215]:     </disk>
Nov 11 01:44:34 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:44:34 user nova-compute[75215]:       <mac address="fa:16:3e:e5:e7:25"/>
Nov 11 01:44:34 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:44:34 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:44:34 user nova-compute[75215]:       <target dev="tap79fc7525-cd"/>
Nov 11 01:44:34 user nova-compute[75215]:     </interface>
Nov 11 01:44:34 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:44:34 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/console.log" append="off"/>
Nov 11 01:44:34 user nova-compute[75215]:     </serial>
Nov 11 01:44:34 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:44:34 user nova-compute[75215]:     <video>
Nov 11 01:44:34 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:44:34 user nova-compute[75215]:     </video>
Nov 11 01:44:34 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:44:34 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:44:34 user nova-compute[75215]:     </rng>
Nov 11 01:44:34 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:44:34 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:44:34 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:44:34 user nova-compute[75215]:     </memballoon>
Nov 11 01:44:34 user nova-compute[75215]:   </devices>
Nov 11 01:44:34 user nova-compute[75215]: </domain>
Nov 11 01:44:34 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:44:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance destroyed successfully.
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:44:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] No VIF found with MAC fa:16:3e:e5:e7:25, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:44:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-83c13312-4390-47bd-821c-98685591fdd2 req-27c23b6d-18dc-4cb8-a8f3-eb8efd5141cf service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-83c13312-4390-47bd-821c-98685591fdd2 req-27c23b6d-18dc-4cb8-a8f3-eb8efd5141cf service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-83c13312-4390-47bd-821c-98685591fdd2 req-27c23b6d-18dc-4cb8-a8f3-eb8efd5141cf service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-83c13312-4390-47bd-821c-98685591fdd2 req-27c23b6d-18dc-4cb8-a8f3-eb8efd5141cf service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-83c13312-4390-47bd-821c-98685591fdd2 req-27c23b6d-18dc-4cb8-a8f3-eb8efd5141cf service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:36 user nova-compute[75215]: WARNING nova.compute.manager [req-83c13312-4390-47bd-821c-98685591fdd2 req-27c23b6d-18dc-4cb8-a8f3-eb8efd5141cf service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state active and task_state rescuing.
Nov 11 01:44:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-b564b2bb-b931-4c53-9dc0-d6859e4f645d req-43a9671e-0710-4a4b-899e-f0d171e3ab39 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b564b2bb-b931-4c53-9dc0-d6859e4f645d req-43a9671e-0710-4a4b-899e-f0d171e3ab39 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b564b2bb-b931-4c53-9dc0-d6859e4f645d req-43a9671e-0710-4a4b-899e-f0d171e3ab39 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b564b2bb-b931-4c53-9dc0-d6859e4f645d req-43a9671e-0710-4a4b-899e-f0d171e3ab39 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-b564b2bb-b931-4c53-9dc0-d6859e4f645d req-43a9671e-0710-4a4b-899e-f0d171e3ab39 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:38 user nova-compute[75215]: WARNING nova.compute.manager [req-b564b2bb-b931-4c53-9dc0-d6859e4f645d req-43a9671e-0710-4a4b-899e-f0d171e3ab39 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state active and task_state rescuing.
Nov 11 01:44:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ceaea34b-480d-48aa-9af8-d39ac7bfacc1 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:44:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "34678116-4acb-438f-b14a-16459c723573" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:44:41 user nova-compute[75215]: INFO nova.compute.claims [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Claim successful on node user
Nov 11 01:44:41 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:44:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:44:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:44:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG nova.policy [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11c0895e92ca4572b6f004d360f18eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739153e36b674c839c8d7bb97201e4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:44:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Creating image(s)
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.237s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk 1073741824" returned: 0 in 0.066s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.236s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Successfully created port: d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Cannot resize image /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Ensure instance console log exists: /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Successfully updated port: d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquired lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-05203ab7-18cc-4136-b610-58c4fd4454d5 req-98dd5800-1c5b-44d7-a1ec-57b92987c92c service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-changed-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-05203ab7-18cc-4136-b610-58c4fd4454d5 req-98dd5800-1c5b-44d7-a1ec-57b92987c92c service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Refreshing instance network info cache due to event network-changed-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05203ab7-18cc-4136-b610-58c4fd4454d5 req-98dd5800-1c5b-44d7-a1ec-57b92987c92c service nova] Acquiring lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:44:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating instance_info_cache with network_info: [{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Releasing lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance network_info: |[{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05203ab7-18cc-4136-b610-58c4fd4454d5 req-98dd5800-1c5b-44d7-a1ec-57b92987c92c service nova] Acquired lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-05203ab7-18cc-4136-b610-58c4fd4454d5 req-98dd5800-1c5b-44d7-a1ec-57b92987c92c service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Refreshing network info cache for port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Start _get_guest_xml network_info=[{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:44:44 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:44 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-934126155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-934126155',id=31,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFJcOSgaYf9+mZkYkxCrUGuCwgbtYACCzTwvkkfejrTLhFkXUkm/xvYjqPtTcwDDcbXKKS0+8uzbi3Uavxrcs1Lk2l9AbCd0/2kPIJxp+JtETMO9p/rfjYVv3PHVhxPww==',key_name='tempest-keypair-848868881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-n9wqxq0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=34678116-4acb-438f-b14a-16459c723573,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'pci_devices' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:44:44 user nova-compute[75215]:   <uuid>34678116-4acb-438f-b14a-16459c723573</uuid>
Nov 11 01:44:44 user nova-compute[75215]:   <name>instance-0000001f</name>
Nov 11 01:44:44 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:44:44 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:44:44 user nova-compute[75215]:   <metadata>
Nov 11 01:44:44 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:44:44 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:44:44 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-934126155</nova:name>
Nov 11 01:44:44 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:44:44</nova:creationTime>
Nov 11 01:44:44 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:44:44 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:44:44 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:44:44 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:44:44 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:44:44 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:44:44 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:44:44 user nova-compute[75215]:       <nova:owner>
Nov 11 01:44:44 user nova-compute[75215]:         <nova:user uuid="11c0895e92ca4572b6f004d360f18eaf">tempest-AttachVolumeShelveTestJSON-1029212070-project-member</nova:user>
Nov 11 01:44:44 user nova-compute[75215]:         <nova:project uuid="739153e36b674c839c8d7bb97201e4aa">tempest-AttachVolumeShelveTestJSON-1029212070</nova:project>
Nov 11 01:44:44 user nova-compute[75215]:       </nova:owner>
Nov 11 01:44:44 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:44:44 user nova-compute[75215]:       <nova:ports>
Nov 11 01:44:44 user nova-compute[75215]:         <nova:port uuid="d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac">
Nov 11 01:44:44 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 11 01:44:44 user nova-compute[75215]:         </nova:port>
Nov 11 01:44:44 user nova-compute[75215]:       </nova:ports>
Nov 11 01:44:44 user nova-compute[75215]:     </nova:instance>
Nov 11 01:44:44 user nova-compute[75215]:   </metadata>
Nov 11 01:44:44 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:44:44 user nova-compute[75215]:     <system>
Nov 11 01:44:44 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:44:44 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:44:44 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:44:44 user nova-compute[75215]:       <entry name="serial">34678116-4acb-438f-b14a-16459c723573</entry>
Nov 11 01:44:44 user nova-compute[75215]:       <entry name="uuid">34678116-4acb-438f-b14a-16459c723573</entry>
Nov 11 01:44:44 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:44:44 user nova-compute[75215]:     </system>
Nov 11 01:44:44 user nova-compute[75215]:   </sysinfo>
Nov 11 01:44:44 user nova-compute[75215]:   <os>
Nov 11 01:44:44 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:44:44 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:44:44 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:44:44 user nova-compute[75215]:   </os>
Nov 11 01:44:44 user nova-compute[75215]:   <features>
Nov 11 01:44:44 user nova-compute[75215]:     <acpi/>
Nov 11 01:44:44 user nova-compute[75215]:     <apic/>
Nov 11 01:44:44 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:44:44 user nova-compute[75215]:   </features>
Nov 11 01:44:44 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:44:44 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:44:44 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:44:44 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:44:44 user nova-compute[75215]:   </clock>
Nov 11 01:44:44 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:44:44 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:44:44 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:44:44 user nova-compute[75215]:   </cpu>
Nov 11 01:44:44 user nova-compute[75215]:   <devices>
Nov 11 01:44:44 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:44:44 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:44:44 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk"/>
Nov 11 01:44:44 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:44:44 user nova-compute[75215]:     </disk>
Nov 11 01:44:44 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:44:44 user nova-compute[75215]:       <mac address="fa:16:3e:d4:9e:9e"/>
Nov 11 01:44:44 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:44:44 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:44:44 user nova-compute[75215]:       <target dev="tapd6d90c48-0e"/>
Nov 11 01:44:44 user nova-compute[75215]:     </interface>
Nov 11 01:44:44 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:44:44 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/console.log" append="off"/>
Nov 11 01:44:44 user nova-compute[75215]:     </serial>
Nov 11 01:44:44 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:44:44 user nova-compute[75215]:     <video>
Nov 11 01:44:44 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:44:44 user nova-compute[75215]:     </video>
Nov 11 01:44:44 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:44:44 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:44:44 user nova-compute[75215]:     </rng>
Nov 11 01:44:44 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:44:44 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:44:44 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:44:44 user nova-compute[75215]:     </memballoon>
Nov 11 01:44:44 user nova-compute[75215]:   </devices>
Nov 11 01:44:44 user nova-compute[75215]: </domain>
Nov 11 01:44:44 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-934126155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-934126155',id=31,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFJcOSgaYf9+mZkYkxCrUGuCwgbtYACCzTwvkkfejrTLhFkXUkm/xvYjqPtTcwDDcbXKKS0+8uzbi3Uavxrcs1Lk2l9AbCd0/2kPIJxp+JtETMO9p/rfjYVv3PHVhxPww==',key_name='tempest-keypair-848868881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-n9wqxq0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=34678116-4acb-438f-b14a-16459c723573,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG os_vif [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8332a487-f0be-5e90-8469-8f88bb8e7d71', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6d90c48-0e, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6d90c48-0e, col_values=(('qos', UUID('a7023e58-cfcc-4d48-8b29-0fdb310fdd20')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6d90c48-0e, col_values=(('external_ids', {'iface-id': 'd6d90c48-0ee3-4fd6-9168-cfc2f979d8ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:9e:9e', 'vm-uuid': '34678116-4acb-438f-b14a-16459c723573'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:44 user nova-compute[75215]: INFO os_vif [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e')
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:44:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No VIF found with MAC fa:16:3e:d4:9e:9e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:44:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-05203ab7-18cc-4136-b610-58c4fd4454d5 req-98dd5800-1c5b-44d7-a1ec-57b92987c92c service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Updated VIF entry in instance network info cache for port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:44:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-05203ab7-18cc-4136-b610-58c4fd4454d5 req-98dd5800-1c5b-44d7-a1ec-57b92987c92c service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating instance_info_cache with network_info: [{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:44:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05203ab7-18cc-4136-b610-58c4fd4454d5 req-98dd5800-1c5b-44d7-a1ec-57b92987c92c service nova] Releasing lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:44:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-baa4137f-bb0e-4913-89da-cb970ea04325 req-4f085a4f-1e3a-4ddc-943e-b6694f545fe8 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-baa4137f-bb0e-4913-89da-cb970ea04325 req-4f085a4f-1e3a-4ddc-943e-b6694f545fe8 service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-baa4137f-bb0e-4913-89da-cb970ea04325 req-4f085a4f-1e3a-4ddc-943e-b6694f545fe8 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-baa4137f-bb0e-4913-89da-cb970ea04325 req-4f085a4f-1e3a-4ddc-943e-b6694f545fe8 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-baa4137f-bb0e-4913-89da-cb970ea04325 req-4f085a4f-1e3a-4ddc-943e-b6694f545fe8 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:46 user nova-compute[75215]: WARNING nova.compute.manager [req-baa4137f-bb0e-4913-89da-cb970ea04325 req-4f085a4f-1e3a-4ddc-943e-b6694f545fe8 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state building and task_state spawning.
Nov 11 01:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-73bc00a8-2f9f-4871-b43d-741483a4771d req-797832bb-3c6e-4d6d-a158-060881b78ed6 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73bc00a8-2f9f-4871-b43d-741483a4771d req-797832bb-3c6e-4d6d-a158-060881b78ed6 service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73bc00a8-2f9f-4871-b43d-741483a4771d req-797832bb-3c6e-4d6d-a158-060881b78ed6 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-73bc00a8-2f9f-4871-b43d-741483a4771d req-797832bb-3c6e-4d6d-a158-060881b78ed6 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-73bc00a8-2f9f-4871-b43d-741483a4771d req-797832bb-3c6e-4d6d-a158-060881b78ed6 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:44:48 user nova-compute[75215]: WARNING nova.compute.manager [req-73bc00a8-2f9f-4871-b43d-741483a4771d req-797832bb-3c6e-4d6d-a158-060881b78ed6 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state building and task_state spawning.
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:44:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance spawned successfully.
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:44:48 user nova-compute[75215]: INFO nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 11 01:44:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:44:48 user nova-compute[75215]: INFO nova.compute.manager [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Took 7.51 seconds to build instance.
Nov 11 01:44:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-79d59c66-b696-4fb3-b1f4-09b185538f90 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.628s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbFpyWIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:44:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:44:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:44:49 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa538b-9ea1-49de-9209-38177f9f0010]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:44:49 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d18b18c-10bc-46e3-b60a-6576a7ac046a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528] added
Nov 11 01:44:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2065e058-8d7b-454d-8b7e-f07141b116b6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7adfa81-2084-4f15-aa45-58a4f7597a37]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbFpyWIV {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbFpyWIV" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fbe22a-51db-4852-af9a-ccacad158073]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sbFpyWIV'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[462ccb23-7c8c-4624-b886-f8d9cd8a501e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d74d04-653a-462e-80a3-5e58bfae09da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:44:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:44:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e316368-cb00-4eaf-8cca-756961a38e25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528, portal: 172.16.0.220,3260]
Nov 11 01:44:49 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528, portal: 172.16.0.220,3260] successful.
Nov 11 01:44:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a84412-65c8-4523-b9bd-223ababae119]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf6dd4-5cb6-4d7e-8e91-d53cca1f55eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:44:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:44:49 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:44:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee11e6b-eb3f-4b55-bb0c-a1acb374af3c]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:44:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbFpyWIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26166346633666135', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166346633666135', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG nova.objects.instance [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:44:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:44:50 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:44:50 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:44:50 user nova-compute[75215]:   <serial>4f1f87d0-2756-4326-9b1e-d985cc49f528</serial>
Nov 11 01:44:50 user nova-compute[75215]: </disk>
Nov 11 01:44:50 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:44:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:44:50 user nova-compute[75215]: INFO nova.compute.manager [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Detaching volume 7942f82a-eb3a-43e7-8d67-3f2f1636dc8f
Nov 11 01:44:50 user nova-compute[75215]: INFO nova.virt.block_device [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Attempting to driver detach volume 7942f82a-eb3a-43e7-8d67-3f2f1636dc8f from mountpoint /dev/vdb
Nov 11 01:44:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Attempting to detach device vdb from instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:44:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:44:51 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:44:51 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:44:51 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:44:51 user nova-compute[75215]:   <serial>7942f82a-eb3a-43e7-8d67-3f2f1636dc8f</serial>
Nov 11 01:44:51 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:44:51 user nova-compute[75215]: </disk>
Nov 11 01:44:51 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:44:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully detached device vdb from instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 from the persistent domain config.
Nov 11 01:44:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:44:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:44:51 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:44:51 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:44:51 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:44:51 user nova-compute[75215]:   <serial>7942f82a-eb3a-43e7-8d67-3f2f1636dc8f</serial>
Nov 11 01:44:51 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:44:51 user nova-compute[75215]: </disk>
Nov 11 01:44:51 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:44:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:44:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:44:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No VIF found with MAC fa:16:3e:d8:8e:90, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:44:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-1406a392-3795-4e2e-a3d8-ab10c8c997ea tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 53.150s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:44:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:44:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:44:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:02 user nova-compute[75215]: INFO nova.compute.manager [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Attaching volume e2bb3d2a-a250-484c-b523-675ec7db5971 to /dev/vdc
Nov 11 01:45:02 user nova-compute[75215]: DEBUG os_brick.utils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace173b3-0f94-420f-a86d-acf87e048419]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74b90dc-8707-470a-bb47-ee4d42a0d892]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c25e379-f3b3-4840-afe4-7c999023baf7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3fa751-9ef2-41a8-87e5-b623ad1f124f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:45:02 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:45:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c0dac-9ff0-4338-901d-f46b2cce61fe]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG os_brick.utils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:45:02 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updating existing volume attachment record: 64f55d84-151a-41e0-86e4-7ed399c3626b {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:11 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 is timed out.
Nov 11 01:45:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully detached device vdb from instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 from the live domain config.
Nov 11 01:45:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTukDqna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:45:11 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1e4d67-5e5f-4f15-a0d8-98a4b7994b13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:45:11 user nova-compute[75215]: No targets found.
Nov 11 01:45:11 user nova-compute[75215]: iSNS:
Nov 11 01:45:11 user nova-compute[75215]: No targets found.
Nov 11 01:45:11 user nova-compute[75215]: STATIC:
Nov 11 01:45:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f
Nov 11 01:45:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:45:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:45:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e
Nov 11 01:45:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:45:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:45:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528
Nov 11 01:45:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:45:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:45:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9
Nov 11 01:45:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:45:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:45:11 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:45:11 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:45:11 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:45:11 user nova-compute[75215]: FIRMWARE:
Nov 11 01:45:11 user nova-compute[75215]: No targets found.
Nov 11 01:45:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:45:11 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:45:11 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3dc70b-29d2-47fa-9b4c-ffa81673c2fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[286e11f8-7978-424b-8b96-02f9724d25ea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:45:11 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:45:11 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:45:11 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:45:11 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:45:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:45:11 user nova-compute[75215]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f (non-flash)
Nov 11 01:45:11 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:45:11 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:45:11 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:45:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4064667f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f'): ({'sdf'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Removing single pathed devices sdf {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ab09a-f2b8-4c04-89d4-3378f8f53fb9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1891bab3-81ed-4d94-86a3-be62b83d7037]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flushing IO for device /dev/sdf {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f45c5c4-64c9-4633-b2f4-0acc08843cd9]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff007dc3-4244-4f2e-802b-cd3fc2ea7fcd]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1038604-b484-4ede-85b9-507955be63cc]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdb13da-d4ff-414f-92f8-ff4025b57c68]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f, portal: 172.16.0.220,3260]
Nov 11 01:45:11 user nova-compute[75215]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f, portal: 172.16.0.220,3260] successful.
Nov 11 01:45:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942f82a-eb3a-43e7-8d67-3f2f1636dc8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed24d6b-5314-4212-ba9c-27943cd94284]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== disconnect_volume: return (345ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:45:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:45:12 user nova-compute[75215]: DEBUG nova.objects.instance [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid d207b4de-98f2-41ce-ba8f-af7583b6bb76 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-43c89cda-9cd5-40c4-9b3c-2ee3c7d58e02 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.143s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:45:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:45:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:45:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7205MB free_disk=25.02399444580078GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Going to confirm migration 1 {{(pid=75215) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Applying migration context for instance 298c4f12-029f-407a-a71f-d5c722655f8d as it has an incoming, in-progress migration ad65b427-adac-4d1d-b712-840ca87f0c9d. Migration status is confirming {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 11 01:45:25 user nova-compute[75215]: INFO nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating resource usage from migration ad65b427-adac-4d1d-b712-840ca87f0c9d
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 323cc88a-b1b3-4a44-9674-818ba3e317f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d207b4de-98f2-41ce-ba8f-af7583b6bb76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Migration ad65b427-adac-4d1d-b712-840ca87f0c9d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 298c4f12-029f-407a-a71f-d5c722655f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 34678116-4acb-438f-b14a-16459c723573 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquired lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'info_cache' on Instance uuid 298c4f12-029f-407a-a71f-d5c722655f8d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.network.neutron [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating instance_info_cache with network_info: [{"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Releasing lock "refresh_cache-298c4f12-029f-407a-a71f-d5c722655f8d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'migration_context' on Instance uuid 298c4f12-029f-407a-a71f-d5c722655f8d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG nova.objects.base [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Object Instance<298c4f12-029f-407a-a71f-d5c722655f8d> lazy-loaded attributes: info_cache,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:45:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:45:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.504s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:26 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Deleted allocation for migration ad65b427-adac-4d1d-b712-840ca87f0c9d
Nov 11 01:45:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-63662a39-9306-4c43-8196-2f32751737ef tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.539s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:45:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:45:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:45:28 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Updating instance_info_cache with network_info: [{"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-473f1cfa-fcac-4d21-99ee-bdb8140c315e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:31 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:45:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:41 user nova-compute[75215]: INFO nova.compute.manager [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Terminating instance
Nov 11 01:45:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ed79fc2-a88a-4944-a232-4753947a7a1a req-99088c51-064a-47ea-a511-73d1ce7f3ec4 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received event network-vif-unplugged-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ed79fc2-a88a-4944-a232-4753947a7a1a req-99088c51-064a-47ea-a511-73d1ce7f3ec4 service nova] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ed79fc2-a88a-4944-a232-4753947a7a1a req-99088c51-064a-47ea-a511-73d1ce7f3ec4 service nova] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ed79fc2-a88a-4944-a232-4753947a7a1a req-99088c51-064a-47ea-a511-73d1ce7f3ec4 service nova] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ed79fc2-a88a-4944-a232-4753947a7a1a req-99088c51-064a-47ea-a511-73d1ce7f3ec4 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] No waiting events found dispatching network-vif-unplugged-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:45:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ed79fc2-a88a-4944-a232-4753947a7a1a req-99088c51-064a-47ea-a511-73d1ce7f3ec4 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received event network-vif-unplugged-f60519c0-e63a-490a-82cb-60c9aef6020d for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:45:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Instance destroyed successfully.
Nov 11 01:45:42 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'resources' on Instance uuid d207b4de-98f2-41ce-ba8f-af7583b6bb76 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-71869212',display_name='tempest-AttachVolumeNegativeTest-server-71869212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-71869212',id=22,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbdNS9WnPXP1iMjovH1ER1bS63ztHAifd6Ih9uEa8RZfAjQiY56Vl0hkXNASaOdMuB1dW7fF/In8carz+sQ3sLL35EkpSKHgYI2VLwzpZoFdJFKM0nj/hOPW5vMBSpoWw==',key_name='tempest-keypair-1496982466',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:39:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-q8xhcv19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=d207b4de-98f2-41ce-ba8f-af7583b6bb76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "f60519c0-e63a-490a-82cb-60c9aef6020d", "address": "fa:16:3e:56:3e:4d", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60519c0-e6", "ovs_interfaceid": "f60519c0-e63a-490a-82cb-60c9aef6020d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=f60519c0-e63a-490a-82cb-60c9aef6020d,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60519c0-e6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG os_vif [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=f60519c0-e63a-490a-82cb-60c9aef6020d,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60519c0-e6') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf60519c0-e6, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adebd9b9-7fb3-43c1-bd99-12d5a08a8a1e) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:42 user nova-compute[75215]: INFO os_vif [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=f60519c0-e63a-490a-82cb-60c9aef6020d,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60519c0-e6')
Nov 11 01:45:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Deleting instance files /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76_del
Nov 11 01:45:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Deletion of /opt/stack/data/nova/instances/d207b4de-98f2-41ce-ba8f-af7583b6bb76_del complete
Nov 11 01:45:42 user nova-compute[75215]: INFO nova.compute.manager [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 11 01:45:42 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:45:42 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:45:43 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Took 1.07 seconds to deallocate network for instance.
Nov 11 01:45:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-e8edc0e8-81d5-41f1-8aee-4325f545a89e req-4d13b10e-e5fd-42eb-9ef3-ce040bb844b4 service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received event network-vif-deleted-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f57e73ce-ef85-48b0-81d8-b55f8d0aa027 req-f234279a-236b-445d-8f75-881bc41828da service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received event network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f57e73ce-ef85-48b0-81d8-b55f8d0aa027 req-f234279a-236b-445d-8f75-881bc41828da service nova] Acquiring lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f57e73ce-ef85-48b0-81d8-b55f8d0aa027 req-f234279a-236b-445d-8f75-881bc41828da service nova] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f57e73ce-ef85-48b0-81d8-b55f8d0aa027 req-f234279a-236b-445d-8f75-881bc41828da service nova] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f57e73ce-ef85-48b0-81d8-b55f8d0aa027 req-f234279a-236b-445d-8f75-881bc41828da service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] No waiting events found dispatching network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:45:43 user nova-compute[75215]: WARNING nova.compute.manager [req-f57e73ce-ef85-48b0-81d8-b55f8d0aa027 req-f234279a-236b-445d-8f75-881bc41828da service nova] [instance: d207b4de-98f2-41ce-ba8f-af7583b6bb76] Received unexpected event network-vif-plugged-f60519c0-e63a-490a-82cb-60c9aef6020d for instance with vm_state deleted and task_state None.
Nov 11 01:45:43 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:45:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:43 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Deleted allocations for instance d207b4de-98f2-41ce-ba8f-af7583b6bb76
Nov 11 01:45:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e38aa556-1e4e-4fc0-af5f-3e6c084299b4 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "d207b4de-98f2-41ce-ba8f-af7583b6bb76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.817s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 330defc6-9b43-4f1e-9a76-94b23750e1b0 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid ad403c50-a8fe-442f-9189-0a6925580739 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 473f1cfa-fcac-4d21-99ee-bdb8140c315e {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 323cc88a-b1b3-4a44-9674-818ba3e317f2 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 298c4f12-029f-407a-a71f-d5c722655f8d {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ad403c50-a8fe-442f-9189-0a6925580739" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "298c4f12-029f-407a-a71f-d5c722655f8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "34678116-4acb-438f-b14a-16459c723573" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "34678116-4acb-438f-b14a-16459c723573" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ad403c50-a8fe-442f-9189-0a6925580739" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "298c4f12-029f-407a-a71f-d5c722655f8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "34678116-4acb-438f-b14a-16459c723573" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-01761f57-1a9b-41d0-a455-f6483d730cc1 req-2d98d70c-89b4-4e34-bfd2-7b239bfc42d7 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received event network-changed-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:45:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-01761f57-1a9b-41d0-a455-f6483d730cc1 req-2d98d70c-89b4-4e34-bfd2-7b239bfc42d7 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Refreshing instance network info cache due to event network-changed-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:45:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-01761f57-1a9b-41d0-a455-f6483d730cc1 req-2d98d70c-89b4-4e34-bfd2-7b239bfc42d7 service nova] Acquiring lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:45:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-01761f57-1a9b-41d0-a455-f6483d730cc1 req-2d98d70c-89b4-4e34-bfd2-7b239bfc42d7 service nova] Acquired lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:45:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-01761f57-1a9b-41d0-a455-f6483d730cc1 req-2d98d70c-89b4-4e34-bfd2-7b239bfc42d7 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Refreshing network info cache for port ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:45:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-01761f57-1a9b-41d0-a455-f6483d730cc1 req-2d98d70c-89b4-4e34-bfd2-7b239bfc42d7 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updated VIF entry in instance network info cache for port ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:45:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-01761f57-1a9b-41d0-a455-f6483d730cc1 req-2d98d70c-89b4-4e34-bfd2-7b239bfc42d7 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating instance_info_cache with network_info: [{"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:45:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-01761f57-1a9b-41d0-a455-f6483d730cc1 req-2d98d70c-89b4-4e34-bfd2-7b239bfc42d7 service nova] Releasing lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:45:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:45:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:45:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:45:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:45:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:56 user nova-compute[75215]: INFO nova.compute.manager [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Rescuing
Nov 11 01:45:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:45:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquired lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:45:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Releasing lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-f7097362-08a9-4883-8eb0-366209faaaae req-09681d20-d6eb-451d-91ba-c118fbedf23b service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f7097362-08a9-4883-8eb0-366209faaaae req-09681d20-d6eb-451d-91ba-c118fbedf23b service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f7097362-08a9-4883-8eb0-366209faaaae req-09681d20-d6eb-451d-91ba-c118fbedf23b service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f7097362-08a9-4883-8eb0-366209faaaae req-09681d20-d6eb-451d-91ba-c118fbedf23b service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-f7097362-08a9-4883-8eb0-366209faaaae req-09681d20-d6eb-451d-91ba-c118fbedf23b service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:45:57 user nova-compute[75215]: WARNING nova.compute.manager [req-f7097362-08a9-4883-8eb0-366209faaaae req-09681d20-d6eb-451d-91ba-c118fbedf23b service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state active and task_state rescuing.
Nov 11 01:45:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance destroyed successfully.
Nov 11 01:45:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Attempting rescue
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 01:45:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Creating image(s)
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue" returned: 0 in 0.064s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'migration_context' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<6bd67e17-1262-4cf5-83cf-5de6852e5d7e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Start _get_guest_xml network_info=[{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:21:e6:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'resources' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<6bd67e17-1262-4cf5-83cf-5de6852e5d7e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'numa_topology' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<6bd67e17-1262-4cf5-83cf-5de6852e5d7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:45:58 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:45:58 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<6bd67e17-1262-4cf5-83cf-5de6852e5d7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1868885677',display_name='tempest-ServerRescueNegativeTestJSON-server-1868885677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1868885677',id=24,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-6hfs45g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:41:15Z,user_data=None,user_id='2c11f7630148412285910f06eade4923',uuid=6bd67e17-1262-4cf5-83cf-5de6852e5d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:21:e6:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:21:e6:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:e6:b0,bridge_name='br-int',has_traffic_filtering=True,id=5108ba03-5c01-43b3-b46d-9ed376611b44,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5108ba03-5c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.objects.base [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<6bd67e17-1262-4cf5-83cf-5de6852e5d7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:45:58 user nova-compute[75215]:   <uuid>6bd67e17-1262-4cf5-83cf-5de6852e5d7e</uuid>
Nov 11 01:45:58 user nova-compute[75215]:   <name>instance-00000018</name>
Nov 11 01:45:58 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:45:58 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:45:58 user nova-compute[75215]:   <metadata>
Nov 11 01:45:58 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:45:58 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:45:58 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1868885677</nova:name>
Nov 11 01:45:58 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:45:58</nova:creationTime>
Nov 11 01:45:58 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:45:58 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:45:58 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:45:58 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:45:58 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:45:58 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:45:58 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:45:58 user nova-compute[75215]:       <nova:owner>
Nov 11 01:45:58 user nova-compute[75215]:         <nova:user uuid="2c11f7630148412285910f06eade4923">tempest-ServerRescueNegativeTestJSON-107483545-project-member</nova:user>
Nov 11 01:45:58 user nova-compute[75215]:         <nova:project uuid="dddded455ac3456e9316603170bb6fea">tempest-ServerRescueNegativeTestJSON-107483545</nova:project>
Nov 11 01:45:58 user nova-compute[75215]:       </nova:owner>
Nov 11 01:45:58 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:45:58 user nova-compute[75215]:       <nova:ports>
Nov 11 01:45:58 user nova-compute[75215]:         <nova:port uuid="5108ba03-5c01-43b3-b46d-9ed376611b44">
Nov 11 01:45:58 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 11 01:45:58 user nova-compute[75215]:         </nova:port>
Nov 11 01:45:58 user nova-compute[75215]:       </nova:ports>
Nov 11 01:45:58 user nova-compute[75215]:     </nova:instance>
Nov 11 01:45:58 user nova-compute[75215]:   </metadata>
Nov 11 01:45:58 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:45:58 user nova-compute[75215]:     <system>
Nov 11 01:45:58 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:45:58 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:45:58 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:45:58 user nova-compute[75215]:       <entry name="serial">6bd67e17-1262-4cf5-83cf-5de6852e5d7e</entry>
Nov 11 01:45:58 user nova-compute[75215]:       <entry name="uuid">6bd67e17-1262-4cf5-83cf-5de6852e5d7e</entry>
Nov 11 01:45:58 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:45:58 user nova-compute[75215]:     </system>
Nov 11 01:45:58 user nova-compute[75215]:   </sysinfo>
Nov 11 01:45:58 user nova-compute[75215]:   <os>
Nov 11 01:45:58 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:45:58 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:45:58 user nova-compute[75215]:   </os>
Nov 11 01:45:58 user nova-compute[75215]:   <features>
Nov 11 01:45:58 user nova-compute[75215]:     <acpi/>
Nov 11 01:45:58 user nova-compute[75215]:     <apic/>
Nov 11 01:45:58 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:45:58 user nova-compute[75215]:   </features>
Nov 11 01:45:58 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:45:58 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:45:58 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:45:58 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:45:58 user nova-compute[75215]:   </clock>
Nov 11 01:45:58 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:45:58 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:45:58 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:45:58 user nova-compute[75215]:   </cpu>
Nov 11 01:45:58 user nova-compute[75215]:   <devices>
Nov 11 01:45:58 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:45:58 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:45:58 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue"/>
Nov 11 01:45:58 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:45:58 user nova-compute[75215]:     </disk>
Nov 11 01:45:58 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:45:58 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:45:58 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk"/>
Nov 11 01:45:58 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:45:58 user nova-compute[75215]:     </disk>
Nov 11 01:45:58 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:45:58 user nova-compute[75215]:       <mac address="fa:16:3e:21:e6:b0"/>
Nov 11 01:45:58 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:45:58 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:45:58 user nova-compute[75215]:       <target dev="tap5108ba03-5c"/>
Nov 11 01:45:58 user nova-compute[75215]:     </interface>
Nov 11 01:45:58 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:45:58 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/console.log" append="off"/>
Nov 11 01:45:58 user nova-compute[75215]:     </serial>
Nov 11 01:45:58 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:45:58 user nova-compute[75215]:     <video>
Nov 11 01:45:58 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:45:58 user nova-compute[75215]:     </video>
Nov 11 01:45:58 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:45:58 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:45:58 user nova-compute[75215]:     </rng>
Nov 11 01:45:58 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:45:58 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:45:58 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:45:58 user nova-compute[75215]:     </memballoon>
Nov 11 01:45:58 user nova-compute[75215]:   </devices>
Nov 11 01:45:58 user nova-compute[75215]: </domain>
Nov 11 01:45:58 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:45:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance destroyed successfully.
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:45:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No VIF found with MAC fa:16:3e:21:e6:b0, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:45:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:45:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-298e25f0-1c50-4a51-b235-5a63736e1e8e req-44f4de3e-c98d-4eef-9d39-53f385aa4815 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-298e25f0-1c50-4a51-b235-5a63736e1e8e req-44f4de3e-c98d-4eef-9d39-53f385aa4815 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-298e25f0-1c50-4a51-b235-5a63736e1e8e req-44f4de3e-c98d-4eef-9d39-53f385aa4815 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:45:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-298e25f0-1c50-4a51-b235-5a63736e1e8e req-44f4de3e-c98d-4eef-9d39-53f385aa4815 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:45:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-298e25f0-1c50-4a51-b235-5a63736e1e8e req-44f4de3e-c98d-4eef-9d39-53f385aa4815 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:45:59 user nova-compute[75215]: WARNING nova.compute.manager [req-298e25f0-1c50-4a51-b235-5a63736e1e8e req-44f4de3e-c98d-4eef-9d39-53f385aa4815 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state active and task_state rescuing.
Nov 11 01:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:01 user nova-compute[75215]: WARNING nova.compute.manager [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state active and task_state rescuing.
Nov 11 01:46:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:01 user nova-compute[75215]: WARNING nova.compute.manager [req-e98b6d8b-0c96-42f3-8fcd-e9f7126a486a req-7986f898-0dd2-4fa8-842f-6395e9d7de41 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state active and task_state rescuing.
Nov 11 01:46:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b324072f-cf70-4598-aca2-5fad846bc908 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGpKdPYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:46:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:46:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:46:04 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c57118d-2afc-4915-aa47-68625f3a1226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:46:04 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38593af-1412-40a9-b3ad-29c64390dfc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971] added
Nov 11 01:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193158a-083b-4177-90a1-b0ff2d780b19]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[12077058-d8e8-4647-a311-447053206af4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGpKdPYN {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGpKdPYN" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c9621-ca5b-4b61-ad78-fb8c9b1fd6ac]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fGpKdPYN'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d1d9e5-6463-4a4b-b878-46e38d1256cc]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[27baf768-2f22-446f-9d28-47126b6fd8d2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4531a53c-2fbd-4af6-90ba-b2a2116e6cce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971, portal: 172.16.0.220,3260]
Nov 11 01:46:04 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971, portal: 172.16.0.220,3260] successful.
Nov 11 01:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0d09dc-1f50-4f0b-b33e-1ad9ac801101]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8151d8f-9d0c-459b-a698-7e6816c09c5f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fff90c-76f6-4f32-a0de-e7020859d8e1]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGpKdPYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:46:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:46:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23031646363393864', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031646363393864', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:46:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:46:05 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:46:05 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:46:05 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 11 01:46:05 user nova-compute[75215]:   <serial>e2bb3d2a-a250-484c-b523-675ec7db5971</serial>
Nov 11 01:46:05 user nova-compute[75215]: </disk>
Nov 11 01:46:05 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] No VIF found with MAC fa:16:3e:d8:8e:90, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-357b93dc-c7a5-4264-9e32-707af6214248 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 64.258s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.591s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG nova.objects.instance [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:06 user nova-compute[75215]: INFO nova.compute.manager [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attaching volume cb503f8d-6823-436f-8a97-dd7a416b0b84 to /dev/vdb
Nov 11 01:46:06 user nova-compute[75215]: DEBUG os_brick.utils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[de21e10b-7434-417a-9976-423754833c77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4b3c0f-a598-42b6-b543-a95718e50a57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0593e663-274c-44b6-9740-fc87047ee2fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[34028fb6-dd88-4db9-b09d-89d9c220aa4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:46:06 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:46:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccaf969-cb17-4395-9149-dc5aa8946db3]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG os_brick.utils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:46:06 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating existing volume attachment record: 5e723221-693f-4a43-ac74-b3f7b795b131 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:46:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:07 user nova-compute[75215]: INFO nova.compute.manager [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Detaching volume 4f1f87d0-2756-4326-9b1e-d985cc49f528
Nov 11 01:46:07 user nova-compute[75215]: INFO nova.virt.block_device [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Attempting to driver detach volume 4f1f87d0-2756-4326-9b1e-d985cc49f528 from mountpoint /dev/vdb
Nov 11 01:46:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Attempting to detach device vdb from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:46:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:46:07 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:46:07 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:46:07 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:46:07 user nova-compute[75215]:   <serial>4f1f87d0-2756-4326-9b1e-d985cc49f528</serial>
Nov 11 01:46:07 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:46:07 user nova-compute[75215]: </disk>
Nov 11 01:46:07 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:46:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully detached device vdb from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 from the persistent domain config.
Nov 11 01:46:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:46:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:46:07 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:46:07 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:46:07 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:46:07 user nova-compute[75215]:   <serial>4f1f87d0-2756-4326-9b1e-d985cc49f528</serial>
Nov 11 01:46:07 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:46:07 user nova-compute[75215]: </disk>
Nov 11 01:46:07 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:46:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:46:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:19 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:46:21 user nova-compute[75215]: INFO nova.compute.claims [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Claim successful on node user
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 01:46:21 user nova-compute[75215]: INFO nova.compute.manager [None req-c1d17534-fb36-49c2-bd1e-881cea034052 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Unrescuing
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1d17534-fb36-49c2-bd1e-881cea034052 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1d17534-fb36-49c2-bd1e-881cea034052 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquired lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c1d17534-fb36-49c2-bd1e-881cea034052 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.017s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.network.neutron [None req-c1d17534-fb36-49c2-bd1e-881cea034052 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Updating instance_info_cache with network_info: [{"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1d17534-fb36-49c2-bd1e-881cea034052 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Releasing lock "refresh_cache-7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c1d17534-fb36-49c2-bd1e-881cea034052 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'flavor' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:46:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:46:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.policy [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a895d5d9bef42c2987ea6b1e60e2313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ef1728a5ab4ddca7ec7000b3cff602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:46:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Creating image(s)
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "/opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "/opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-65a7ec54-2f04-4d36-98ac-82524b1e2c88 req-06350cd4-435b-4ad8-9c8c-a9812c265e40 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-65a7ec54-2f04-4d36-98ac-82524b1e2c88 req-06350cd4-435b-4ad8-9c8c-a9812c265e40 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-65a7ec54-2f04-4d36-98ac-82524b1e2c88 req-06350cd4-435b-4ad8-9c8c-a9812c265e40 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-65a7ec54-2f04-4d36-98ac-82524b1e2c88 req-06350cd4-435b-4ad8-9c8c-a9812c265e40 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-65a7ec54-2f04-4d36-98ac-82524b1e2c88 req-06350cd4-435b-4ad8-9c8c-a9812c265e40 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:22 user nova-compute[75215]: WARNING nova.compute.manager [req-65a7ec54-2f04-4d36-98ac-82524b1e2c88 req-06350cd4-435b-4ad8-9c8c-a9812c265e40 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:46:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.223s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk 1073741824" returned: 0 in 0.063s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance destroyed successfully.
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Successfully created port: 2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Cannot resize image /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Ensure instance console log exists: /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Successfully updated port: 2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquired lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-56adb815-74e4-48ec-87b7-bdb21cd953de req-d72cb7e4-6b76-4c3b-82ee-997252c7d369 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Received event network-changed-2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-56adb815-74e4-48ec-87b7-bdb21cd953de req-d72cb7e4-6b76-4c3b-82ee-997252c7d369 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Refreshing instance network info cache due to event network-changed-2620e811-15ec-4d58-8c28-fdf9e3d871f8. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56adb815-74e4-48ec-87b7-bdb21cd953de req-d72cb7e4-6b76-4c3b-82ee-997252c7d369 service nova] Acquiring lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-b19a80e0-8e87-4fa2-aceb-1c4cf7f40a19 req-2512d921-12ba-4bbb-9777-cfe253ca9290 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b19a80e0-8e87-4fa2-aceb-1c4cf7f40a19 req-2512d921-12ba-4bbb-9777-cfe253ca9290 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b19a80e0-8e87-4fa2-aceb-1c4cf7f40a19 req-2512d921-12ba-4bbb-9777-cfe253ca9290 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b19a80e0-8e87-4fa2-aceb-1c4cf7f40a19 req-2512d921-12ba-4bbb-9777-cfe253ca9290 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-b19a80e0-8e87-4fa2-aceb-1c4cf7f40a19 req-2512d921-12ba-4bbb-9777-cfe253ca9290 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:24 user nova-compute[75215]: WARNING nova.compute.manager [req-b19a80e0-8e87-4fa2-aceb-1c4cf7f40a19 req-2512d921-12ba-4bbb-9777-cfe253ca9290 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:46:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:24 user nova-compute[75215]: DEBUG nova.network.neutron [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Updating instance_info_cache with network_info: [{"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Releasing lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Instance network_info: |[{"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56adb815-74e4-48ec-87b7-bdb21cd953de req-d72cb7e4-6b76-4c3b-82ee-997252c7d369 service nova] Acquired lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-56adb815-74e4-48ec-87b7-bdb21cd953de req-d72cb7e4-6b76-4c3b-82ee-997252c7d369 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Refreshing network info cache for port 2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Start _get_guest_xml network_info=[{"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:46:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-864506544',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-864506544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8645065',id=32,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNVODd+2Ry6mP2eD2dCd1T0UInTmkeB1e2/ghdujsK0x4uUoAchnA8s1Z4eqeuJiF3lX4tlL/1MrU5eAfveDSE8+TZh+qnJWWofA9Mgt/fk75MlKEA3eoi11RVJoa0ZA==',key_name='tempest-keypair-186861194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ef1728a5ab4ddca7ec7000b3cff602',ramdisk_id='',reservation_id='r-t5gmsjlw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1160474950',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:46:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a895d5d9bef42c2987ea6b1e60e2313',uuid=2a264905-f5f0-46a9-9ccb-df09c0d6d534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Converting VIF {"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=2620e811-15ec-4d58-8c28-fdf9e3d871f8,network=Network(bb778ba7-bd87-4921-a19f-f70551c753b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620e811-15') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a264905-f5f0-46a9-9ccb-df09c0d6d534 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:46:25 user nova-compute[75215]:   <uuid>2a264905-f5f0-46a9-9ccb-df09c0d6d534</uuid>
Nov 11 01:46:25 user nova-compute[75215]:   <name>instance-00000020</name>
Nov 11 01:46:25 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:46:25 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:46:25 user nova-compute[75215]:   <metadata>
Nov 11 01:46:25 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:46:25 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:46:25 user nova-compute[75215]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-864506544</nova:name>
Nov 11 01:46:25 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:46:25</nova:creationTime>
Nov 11 01:46:25 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:46:25 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:46:25 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:46:25 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:46:25 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:46:25 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:46:25 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:46:25 user nova-compute[75215]:       <nova:owner>
Nov 11 01:46:25 user nova-compute[75215]:         <nova:user uuid="5a895d5d9bef42c2987ea6b1e60e2313">tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member</nova:user>
Nov 11 01:46:25 user nova-compute[75215]:         <nova:project uuid="95ef1728a5ab4ddca7ec7000b3cff602">tempest-TestServerVolumeAttachScenarioOldVersion-1160474950</nova:project>
Nov 11 01:46:25 user nova-compute[75215]:       </nova:owner>
Nov 11 01:46:25 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:46:25 user nova-compute[75215]:       <nova:ports>
Nov 11 01:46:25 user nova-compute[75215]:         <nova:port uuid="2620e811-15ec-4d58-8c28-fdf9e3d871f8">
Nov 11 01:46:25 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:46:25 user nova-compute[75215]:         </nova:port>
Nov 11 01:46:25 user nova-compute[75215]:       </nova:ports>
Nov 11 01:46:25 user nova-compute[75215]:     </nova:instance>
Nov 11 01:46:25 user nova-compute[75215]:   </metadata>
Nov 11 01:46:25 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:46:25 user nova-compute[75215]:     <system>
Nov 11 01:46:25 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:46:25 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:46:25 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:46:25 user nova-compute[75215]:       <entry name="serial">2a264905-f5f0-46a9-9ccb-df09c0d6d534</entry>
Nov 11 01:46:25 user nova-compute[75215]:       <entry name="uuid">2a264905-f5f0-46a9-9ccb-df09c0d6d534</entry>
Nov 11 01:46:25 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:46:25 user nova-compute[75215]:     </system>
Nov 11 01:46:25 user nova-compute[75215]:   </sysinfo>
Nov 11 01:46:25 user nova-compute[75215]:   <os>
Nov 11 01:46:25 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:46:25 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:46:25 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:46:25 user nova-compute[75215]:   </os>
Nov 11 01:46:25 user nova-compute[75215]:   <features>
Nov 11 01:46:25 user nova-compute[75215]:     <acpi/>
Nov 11 01:46:25 user nova-compute[75215]:     <apic/>
Nov 11 01:46:25 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:46:25 user nova-compute[75215]:   </features>
Nov 11 01:46:25 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:46:25 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:46:25 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:46:25 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:46:25 user nova-compute[75215]:   </clock>
Nov 11 01:46:25 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:46:25 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:46:25 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:46:25 user nova-compute[75215]:   </cpu>
Nov 11 01:46:25 user nova-compute[75215]:   <devices>
Nov 11 01:46:25 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:46:25 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:46:25 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk"/>
Nov 11 01:46:25 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:46:25 user nova-compute[75215]:     </disk>
Nov 11 01:46:25 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:46:25 user nova-compute[75215]:       <mac address="fa:16:3e:76:fe:45"/>
Nov 11 01:46:25 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:46:25 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:46:25 user nova-compute[75215]:       <target dev="tap2620e811-15"/>
Nov 11 01:46:25 user nova-compute[75215]:     </interface>
Nov 11 01:46:25 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:46:25 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/console.log" append="off"/>
Nov 11 01:46:25 user nova-compute[75215]:     </serial>
Nov 11 01:46:25 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:46:25 user nova-compute[75215]:     <video>
Nov 11 01:46:25 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:46:25 user nova-compute[75215]:     </video>
Nov 11 01:46:25 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:46:25 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:46:25 user nova-compute[75215]:     </rng>
Nov 11 01:46:25 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:46:25 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:46:25 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:46:25 user nova-compute[75215]:     </memballoon>
Nov 11 01:46:25 user nova-compute[75215]:   </devices>
Nov 11 01:46:25 user nova-compute[75215]: </domain>
Nov 11 01:46:25 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-864506544',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-864506544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8645065',id=32,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNVODd+2Ry6mP2eD2dCd1T0UInTmkeB1e2/ghdujsK0x4uUoAchnA8s1Z4eqeuJiF3lX4tlL/1MrU5eAfveDSE8+TZh+qnJWWofA9Mgt/fk75MlKEA3eoi11RVJoa0ZA==',key_name='tempest-keypair-186861194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ef1728a5ab4ddca7ec7000b3cff602',ramdisk_id='',reservation_id='r-t5gmsjlw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1160474950',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:46:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a895d5d9bef42c2987ea6b1e60e2313',uuid=2a264905-f5f0-46a9-9ccb-df09c0d6d534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Converting VIF {"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=2620e811-15ec-4d58-8c28-fdf9e3d871f8,network=Network(bb778ba7-bd87-4921-a19f-f70551c753b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620e811-15') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG os_vif [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=2620e811-15ec-4d58-8c28-fdf9e3d871f8,network=Network(bb778ba7-bd87-4921-a19f-f70551c753b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620e811-15') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59c63950-3612-548d-ac2e-6452c079afc2', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2620e811-15, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2620e811-15, col_values=(('qos', UUID('4ac8c69d-7088-4d41-b171-d76574967279')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2620e811-15, col_values=(('external_ids', {'iface-id': '2620e811-15ec-4d58-8c28-fdf9e3d871f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:fe:45', 'vm-uuid': '2a264905-f5f0-46a9-9ccb-df09c0d6d534'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: INFO os_vif [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=2620e811-15ec-4d58-8c28-fdf9e3d871f8,network=Network(bb778ba7-bd87-4921-a19f-f70551c753b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620e811-15')
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] No VIF found with MAC fa:16:3e:76:fe:45, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-56adb815-74e4-48ec-87b7-bdb21cd953de req-d72cb7e4-6b76-4c3b-82ee-997252c7d369 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Updated VIF entry in instance network info cache for port 2620e811-15ec-4d58-8c28-fdf9e3d871f8. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG nova.network.neutron [req-56adb815-74e4-48ec-87b7-bdb21cd953de req-d72cb7e4-6b76-4c3b-82ee-997252c7d369 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Updating instance_info_cache with network_info: [{"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-56adb815-74e4-48ec-87b7-bdb21cd953de req-d72cb7e4-6b76-4c3b-82ee-997252c7d369 service nova] Releasing lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:28 user nova-compute[75215]: WARNING nova.compute.manager [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:28 user nova-compute[75215]: WARNING nova.compute.manager [req-db9be717-9339-423a-8607-8035cd58f59b req-b0fbcd16-0506-40c5-8c18-dea770924d77 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c1d17534-fb36-49c2-bd1e-881cea034052 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:46:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:46:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7314MB free_disk=25.037487030029297GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 is timed out.
Nov 11 01:46:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully detached device vdb from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 from the live domain config.
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbFpyWIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:46:28 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb9612-7e95-41e0-b57d-c63819d6084f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:46:28 user nova-compute[75215]: No targets found.
Nov 11 01:46:28 user nova-compute[75215]: iSNS:
Nov 11 01:46:28 user nova-compute[75215]: No targets found.
Nov 11 01:46:28 user nova-compute[75215]: STATIC:
Nov 11 01:46:28 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e
Nov 11 01:46:28 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:28 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:28 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528
Nov 11 01:46:28 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:28 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:28 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9
Nov 11 01:46:28 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:28 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:28 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:46:28 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:28 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:28 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971
Nov 11 01:46:28 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:28 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:28 user nova-compute[75215]: FIRMWARE:
Nov 11 01:46:28 user nova-compute[75215]: No targets found.
Nov 11 01:46:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:46:28 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:46:28 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[439cfaf6-f044-48eb-8c42-c2cb1061a77c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e19174-29df-486f-9421-e4c4699d6f1a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:28 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:28 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:28 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:46:28 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:28 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:28 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:28 user nova-compute[75215]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 (non-flash)
Nov 11 01:46:28 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404435c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 323cc88a-b1b3-4a44-9674-818ba3e317f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 298c4f12-029f-407a-a71f-d5c722655f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 34678116-4acb-438f-b14a-16459c723573 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1bebe6-4157-4fd3-b3a7-1a33ce51730c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: INFO nova.compute.manager [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Terminating instance
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f4440-2386-4856-98df-fe8212d62978]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b758d30a-0a8b-4a5a-9b43-f665f6322a8f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f1d5d6-493a-40d1-80e4-4e8f7ab8b0d1]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b518c944-b2a2-44c6-a70c-055e959a6ea7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --logout" returned: 0 in 0.145s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d12b02-3256-459c-8ea2-3b7db476bc96]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528, portal: 172.16.0.220,3260]
Nov 11 01:46:28 user nova-compute[75215]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528, portal: 172.16.0.220,3260] successful.
Nov 11 01:46:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1f87d0-2756-4326-9b1e-d985cc49f528 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b587301b-bead-4b71-8efb-714afea723cb]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.547s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== disconnect_volume: return (549ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-903d3796-f351-49c5-b7ca-f60031480f43 req-628ebd93-e2eb-4276-b0eb-ad93475d7810 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received event network-vif-unplugged-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-903d3796-f351-49c5-b7ca-f60031480f43 req-628ebd93-e2eb-4276-b0eb-ad93475d7810 service nova] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-903d3796-f351-49c5-b7ca-f60031480f43 req-628ebd93-e2eb-4276-b0eb-ad93475d7810 service nova] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-903d3796-f351-49c5-b7ca-f60031480f43 req-628ebd93-e2eb-4276-b0eb-ad93475d7810 service nova] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-903d3796-f351-49c5-b7ca-f60031480f43 req-628ebd93-e2eb-4276-b0eb-ad93475d7810 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] No waiting events found dispatching network-vif-unplugged-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-903d3796-f351-49c5-b7ca-f60031480f43 req-628ebd93-e2eb-4276-b0eb-ad93475d7810 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received event network-vif-unplugged-4c326aeb-0507-41eb-b3af-3800d713adf1 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Received event network-vif-plugged-2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] Acquiring lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] No waiting events found dispatching network-vif-plugged-2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:29 user nova-compute[75215]: WARNING nova.compute.manager [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Received unexpected event network-vif-plugged-2620e811-15ec-4d58-8c28-fdf9e3d871f8 for instance with vm_state building and task_state spawning.
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Received event network-vif-plugged-2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] Acquiring lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] No waiting events found dispatching network-vif-plugged-2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:29 user nova-compute[75215]: WARNING nova.compute.manager [req-46277dd5-b336-4df8-a2b5-abae8338321c req-69e6c332-6b4c-4f89-b86b-152d2b72af9c service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Received unexpected event network-vif-plugged-2620e811-15ec-4d58-8c28-fdf9e3d871f8 for instance with vm_state building and task_state spawning.
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.089s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Instance destroyed successfully.
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lazy-loading 'resources' on Instance uuid 323cc88a-b1b3-4a44-9674-818ba3e317f2 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1010974391',display_name='tempest-ServerStableDeviceRescueTest-server-1010974391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1010974391',id=21,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfkaGKP83nAJI9Zq4cc9NL1BKWYQSZigF7D2mln0isMcZzQZHIGOUwiELFh9YX356Sy1MZmYJXDZreCsSyFU/X9LaWgNncmobl1tJLKTTZqMlzCeglJPbm2UxvBt2mpIQ==',key_name='tempest-keypair-1030521623',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d112e660a694f1698f81fd725acb1e9',ramdisk_id='',reservation_id='r-0xse7ftp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-790092664',owner_user_name='tempest-ServerStableDeviceRescueTest-790092664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94388f9dde214c389d63b78879564525',uuid=323cc88a-b1b3-4a44-9674-818ba3e317f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Converting VIF {"id": "4c326aeb-0507-41eb-b3af-3800d713adf1", "address": "fa:16:3e:1f:6d:40", "network": {"id": "a84c97a3-7e80-4252-b4ff-be2a905bea92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2103380817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d112e660a694f1698f81fd725acb1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c326aeb-05", "ovs_interfaceid": "4c326aeb-0507-41eb-b3af-3800d713adf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=4c326aeb-0507-41eb-b3af-3800d713adf1,network=Network(a84c97a3-7e80-4252-b4ff-be2a905bea92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c326aeb-05') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG os_vif [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=4c326aeb-0507-41eb-b3af-3800d713adf1,network=Network(a84c97a3-7e80-4252-b4ff-be2a905bea92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c326aeb-05') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c326aeb-05, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cc0b221-f598-49eb-9fac-c7d3f38deae3) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:46:29 user nova-compute[75215]: INFO os_vif [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=4c326aeb-0507-41eb-b3af-3800d713adf1,network=Network(a84c97a3-7e80-4252-b4ff-be2a905bea92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c326aeb-05')
Nov 11 01:46:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Deleting instance files /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2_del
Nov 11 01:46:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Deletion of /opt/stack/data/nova/instances/323cc88a-b1b3-4a44-9674-818ba3e317f2_del complete
Nov 11 01:46:29 user nova-compute[75215]: INFO nova.compute.manager [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 11 01:46:29 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:46:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Instance spawned successfully.
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:30 user nova-compute[75215]: INFO nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Took 7.20 seconds to spawn the instance on the hypervisor.
Nov 11 01:46:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:46:30 user nova-compute[75215]: INFO nova.compute.manager [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Took 8.90 seconds to build instance.
Nov 11 01:46:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2c005415-d27c-4b87-8921-63ba9a91e783 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.022s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-695c270b-2d9a-45be-aea5-421a52d21241 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.641s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:30 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Took 1.24 seconds to deallocate network for instance.
Nov 11 01:46:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-9ed13e06-f389-4537-b3de-50bb4a719ec2 req-6ae6610d-6c40-4d8c-8b37-27c00481a7c7 service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received event network-vif-deleted-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:30 user nova-compute[75215]: INFO nova.compute.manager [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Detaching volume e2bb3d2a-a250-484c-b523-675ec7db5971
Nov 11 01:46:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-a44380ab-55a5-4487-b654-857359f46ace req-4db0cdae-cda1-4c24-a7fe-b47254d0b14f service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received event network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a44380ab-55a5-4487-b654-857359f46ace req-4db0cdae-cda1-4c24-a7fe-b47254d0b14f service nova] Acquiring lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a44380ab-55a5-4487-b654-857359f46ace req-4db0cdae-cda1-4c24-a7fe-b47254d0b14f service nova] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a44380ab-55a5-4487-b654-857359f46ace req-4db0cdae-cda1-4c24-a7fe-b47254d0b14f service nova] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-a44380ab-55a5-4487-b654-857359f46ace req-4db0cdae-cda1-4c24-a7fe-b47254d0b14f service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] No waiting events found dispatching network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:30 user nova-compute[75215]: WARNING nova.compute.manager [req-a44380ab-55a5-4487-b654-857359f46ace req-4db0cdae-cda1-4c24-a7fe-b47254d0b14f service nova] [instance: 323cc88a-b1b3-4a44-9674-818ba3e317f2] Received unexpected event network-vif-plugged-4c326aeb-0507-41eb-b3af-3800d713adf1 for instance with vm_state deleted and task_state None.
Nov 11 01:46:30 user nova-compute[75215]: INFO nova.virt.block_device [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Attempting to driver detach volume e2bb3d2a-a250-484c-b523-675ec7db5971 from mountpoint /dev/vdc
Nov 11 01:46:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Attempting to detach device vdc from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:46:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:46:30 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:46:30 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:46:30 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 11 01:46:30 user nova-compute[75215]:   <serial>e2bb3d2a-a250-484c-b523-675ec7db5971</serial>
Nov 11 01:46:30 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 01:46:30 user nova-compute[75215]: </disk>
Nov 11 01:46:30 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:46:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully detached device vdc from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 from the persistent domain config.
Nov 11 01:46:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:46:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:46:31 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:46:31 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:46:31 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 11 01:46:31 user nova-compute[75215]:   <serial>e2bb3d2a-a250-484c-b523-675ec7db5971</serial>
Nov 11 01:46:31 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 01:46:31 user nova-compute[75215]: </disk>
Nov 11 01:46:31 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:46:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:46:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:46:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.622s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:31 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Deleted allocations for instance 323cc88a-b1b3-4a44-9674-818ba3e317f2
Nov 11 01:46:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:46:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e2b272-d730-42b9-ae4f-75c2316064c8 tempest-ServerStableDeviceRescueTest-790092664 tempest-ServerStableDeviceRescueTest-790092664-project-member] Lock "323cc88a-b1b3-4a44-9674-818ba3e317f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.230s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab66e021-3f60-4615-9a8c-dd3656c501de req-04be1b3e-995d-46ce-9452-b84ad7958983 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-changed-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-ab66e021-3f60-4615-9a8c-dd3656c501de req-04be1b3e-995d-46ce-9452-b84ad7958983 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Refreshing instance network info cache due to event network-changed-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:46:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab66e021-3f60-4615-9a8c-dd3656c501de req-04be1b3e-995d-46ce-9452-b84ad7958983 service nova] Acquiring lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab66e021-3f60-4615-9a8c-dd3656c501de req-04be1b3e-995d-46ce-9452-b84ad7958983 service nova] Acquired lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-ab66e021-3f60-4615-9a8c-dd3656c501de req-04be1b3e-995d-46ce-9452-b84ad7958983 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Refreshing network info cache for port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-ab66e021-3f60-4615-9a8c-dd3656c501de req-04be1b3e-995d-46ce-9452-b84ad7958983 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Updated VIF entry in instance network info cache for port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:46:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-ab66e021-3f60-4615-9a8c-dd3656c501de req-04be1b3e-995d-46ce-9452-b84ad7958983 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating instance_info_cache with network_info: [{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ab66e021-3f60-4615-9a8c-dd3656c501de req-04be1b3e-995d-46ce-9452-b84ad7958983 service nova] Releasing lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:46:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:46:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:46:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:46:36 user nova-compute[75215]: INFO nova.compute.claims [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Claim successful on node user
Nov 11 01:46:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:46:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:46:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG nova.policy [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da821cfc028b48f6864c064b2ea97c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792836033673405bb7375a08ddc89e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:46:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Creating image(s)
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "/opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "/opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk 1073741824" returned: 0 in 0.063s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Successfully created port: 8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.230s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:46:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Cannot resize image /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Ensure instance console log exists: /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuvrSwbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:46:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:46:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:46:38 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61128bd7-8641-4d3a-b1f1-916abd8f3997]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:46:38 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd181b-ac47-434b-a8e0-7aa844bc7abd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84] added
Nov 11 01:46:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aae853-e9eb-4842-a566-68cb4e6855aa]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc13196-dda7-4303-b8c6-3f86fd945da4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuvrSwbN {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuvrSwbN" returned: 0 in 0.035s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca7951b-4ef1-4064-bd14-b61bcad1317f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WuvrSwbN'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[761160d3-0125-4098-96dc-830e0b5af003]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e066ce12-9a04-4ee7-ab43-6db650dfda09]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c967481-c97b-4213-a1af-ff32a5e34a66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84, portal: 172.16.0.220,3260]
Nov 11 01:46:38 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84, portal: 172.16.0.220,3260] successful.
Nov 11 01:46:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e9beb-9b88-4510-aa15-91f48514e249]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fef946-33ff-4653-91fe-0883c3568b33]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)
Nov 11 01:46:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Successfully updated port: 8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[da87d1db-0524-4451-bf67-90b5383b6f31]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuvrSwbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquired lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-63fbf6a3-29af-4f4a-998d-1b3af2665aa4 req-eade1575-b178-4b90-bb61-367f1e62a229 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received event network-changed-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-63fbf6a3-29af-4f4a-998d-1b3af2665aa4 req-eade1575-b178-4b90-bb61-367f1e62a229 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Refreshing instance network info cache due to event network-changed-8e765a41-1fbf-4a36-a5a1-7229317c8538. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-63fbf6a3-29af-4f4a-998d-1b3af2665aa4 req-eade1575-b178-4b90-bb61-367f1e62a229 service nova] Acquiring lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Updating instance_info_cache with network_info: [{"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Releasing lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Instance network_info: |[{"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-63fbf6a3-29af-4f4a-998d-1b3af2665aa4 req-eade1575-b178-4b90-bb61-367f1e62a229 service nova] Acquired lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-63fbf6a3-29af-4f4a-998d-1b3af2665aa4 req-eade1575-b178-4b90-bb61-367f1e62a229 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Refreshing network info cache for port 8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Start _get_guest_xml network_info=[{"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:46:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:46:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-930732941',display_name='tempest-AttachVolumeNegativeTest-server-930732941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-930732941',id=33,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0B9lplB4AeZqPNeI9AaHUpLLwVPTo3fTa7WDyvfuq3i8EotmpjiRHDEzgY/N1wLFzk7Vkejp8jkjUJ6JzyoDreKJlrowSq2rnNBLvrSSP56bdDl0/bMJ4SMzmqSYya9Q==',key_name='tempest-keypair-44535122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-ep2jpupb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=cd88426d-bcc9-4004-855f-a8d5b540ef55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:2a:6e,bridge_name='br-int',has_traffic_filtering=True,id=8e765a41-1fbf-4a36-a5a1-7229317c8538,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e765a41-1f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'pci_devices' on Instance uuid cd88426d-bcc9-4004-855f-a8d5b540ef55 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:46:39 user nova-compute[75215]:   <uuid>cd88426d-bcc9-4004-855f-a8d5b540ef55</uuid>
Nov 11 01:46:39 user nova-compute[75215]:   <name>instance-00000021</name>
Nov 11 01:46:39 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:46:39 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:46:39 user nova-compute[75215]:   <metadata>
Nov 11 01:46:39 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:46:39 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:46:39 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeNegativeTest-server-930732941</nova:name>
Nov 11 01:46:39 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:46:39</nova:creationTime>
Nov 11 01:46:39 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:46:39 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:46:39 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:46:39 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:46:39 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:46:39 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:46:39 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:46:39 user nova-compute[75215]:       <nova:owner>
Nov 11 01:46:39 user nova-compute[75215]:         <nova:user uuid="da821cfc028b48f6864c064b2ea97c02">tempest-AttachVolumeNegativeTest-791087113-project-member</nova:user>
Nov 11 01:46:39 user nova-compute[75215]:         <nova:project uuid="792836033673405bb7375a08ddc89e18">tempest-AttachVolumeNegativeTest-791087113</nova:project>
Nov 11 01:46:39 user nova-compute[75215]:       </nova:owner>
Nov 11 01:46:39 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:46:39 user nova-compute[75215]:       <nova:ports>
Nov 11 01:46:39 user nova-compute[75215]:         <nova:port uuid="8e765a41-1fbf-4a36-a5a1-7229317c8538">
Nov 11 01:46:39 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:46:39 user nova-compute[75215]:         </nova:port>
Nov 11 01:46:39 user nova-compute[75215]:       </nova:ports>
Nov 11 01:46:39 user nova-compute[75215]:     </nova:instance>
Nov 11 01:46:39 user nova-compute[75215]:   </metadata>
Nov 11 01:46:39 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:46:39 user nova-compute[75215]:     <system>
Nov 11 01:46:39 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:46:39 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:46:39 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:46:39 user nova-compute[75215]:       <entry name="serial">cd88426d-bcc9-4004-855f-a8d5b540ef55</entry>
Nov 11 01:46:39 user nova-compute[75215]:       <entry name="uuid">cd88426d-bcc9-4004-855f-a8d5b540ef55</entry>
Nov 11 01:46:39 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:46:39 user nova-compute[75215]:     </system>
Nov 11 01:46:39 user nova-compute[75215]:   </sysinfo>
Nov 11 01:46:39 user nova-compute[75215]:   <os>
Nov 11 01:46:39 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:46:39 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:46:39 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:46:39 user nova-compute[75215]:   </os>
Nov 11 01:46:39 user nova-compute[75215]:   <features>
Nov 11 01:46:39 user nova-compute[75215]:     <acpi/>
Nov 11 01:46:39 user nova-compute[75215]:     <apic/>
Nov 11 01:46:39 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:46:39 user nova-compute[75215]:   </features>
Nov 11 01:46:39 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:46:39 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:46:39 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:46:39 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:46:39 user nova-compute[75215]:   </clock>
Nov 11 01:46:39 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:46:39 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:46:39 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:46:39 user nova-compute[75215]:   </cpu>
Nov 11 01:46:39 user nova-compute[75215]:   <devices>
Nov 11 01:46:39 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:46:39 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:46:39 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk"/>
Nov 11 01:46:39 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:46:39 user nova-compute[75215]:     </disk>
Nov 11 01:46:39 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:46:39 user nova-compute[75215]:       <mac address="fa:16:3e:80:2a:6e"/>
Nov 11 01:46:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:46:39 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:46:39 user nova-compute[75215]:       <target dev="tap8e765a41-1f"/>
Nov 11 01:46:39 user nova-compute[75215]:     </interface>
Nov 11 01:46:39 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:46:39 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/console.log" append="off"/>
Nov 11 01:46:39 user nova-compute[75215]:     </serial>
Nov 11 01:46:39 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:46:39 user nova-compute[75215]:     <video>
Nov 11 01:46:39 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:46:39 user nova-compute[75215]:     </video>
Nov 11 01:46:39 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:46:39 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:46:39 user nova-compute[75215]:     </rng>
Nov 11 01:46:39 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:46:39 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:46:39 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:46:39 user nova-compute[75215]:     </memballoon>
Nov 11 01:46:39 user nova-compute[75215]:   </devices>
Nov 11 01:46:39 user nova-compute[75215]: </domain>
Nov 11 01:46:39 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-930732941',display_name='tempest-AttachVolumeNegativeTest-server-930732941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-930732941',id=33,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0B9lplB4AeZqPNeI9AaHUpLLwVPTo3fTa7WDyvfuq3i8EotmpjiRHDEzgY/N1wLFzk7Vkejp8jkjUJ6JzyoDreKJlrowSq2rnNBLvrSSP56bdDl0/bMJ4SMzmqSYya9Q==',key_name='tempest-keypair-44535122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-ep2jpupb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=cd88426d-bcc9-4004-855f-a8d5b540ef55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:2a:6e,bridge_name='br-int',has_traffic_filtering=True,id=8e765a41-1fbf-4a36-a5a1-7229317c8538,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e765a41-1f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG os_vif [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:2a:6e,bridge_name='br-int',has_traffic_filtering=True,id=8e765a41-1fbf-4a36-a5a1-7229317c8538,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e765a41-1f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '079c4db0-2b27-5712-90f9-46ef7827196e', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e765a41-1f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e765a41-1f, col_values=(('qos', UUID('85d182bf-0760-4acf-b2ee-707bd1d50541')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e765a41-1f, col_values=(('external_ids', {'iface-id': '8e765a41-1fbf-4a36-a5a1-7229317c8538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:2a:6e', 'vm-uuid': 'cd88426d-bcc9-4004-855f-a8d5b540ef55'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:39 user nova-compute[75215]: INFO os_vif [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:2a:6e,bridge_name='br-int',has_traffic_filtering=True,id=8e765a41-1fbf-4a36-a5a1-7229317c8538,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e765a41-1f')
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No VIF found with MAC fa:16:3e:80:2a:6e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-63fbf6a3-29af-4f4a-998d-1b3af2665aa4 req-eade1575-b178-4b90-bb61-367f1e62a229 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Updated VIF entry in instance network info cache for port 8e765a41-1fbf-4a36-a5a1-7229317c8538. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-63fbf6a3-29af-4f4a-998d-1b3af2665aa4 req-eade1575-b178-4b90-bb61-367f1e62a229 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Updating instance_info_cache with network_info: [{"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-63fbf6a3-29af-4f4a-998d-1b3af2665aa4 req-eade1575-b178-4b90-bb61-367f1e62a229 service nova] Releasing lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23831356662623732', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831356662623732', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:46:39 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:46:39 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:46:39 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:46:39 user nova-compute[75215]:   <serial>cb503f8d-6823-436f-8a97-dd7a416b0b84</serial>
Nov 11 01:46:39 user nova-compute[75215]: </disk>
Nov 11 01:46:39 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:46:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:46:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:46:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No VIF found with MAC fa:16:3e:fc:42:0d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:46:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83ecc6d5-b88a-4903-9a88-3afa1729c840 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.226s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-42dc4552-616f-45a6-a87e-ee403b49d7ad req-a3f498d5-bc57-427e-b182-b383d4d0ee2f service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received event network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-42dc4552-616f-45a6-a87e-ee403b49d7ad req-a3f498d5-bc57-427e-b182-b383d4d0ee2f service nova] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-42dc4552-616f-45a6-a87e-ee403b49d7ad req-a3f498d5-bc57-427e-b182-b383d4d0ee2f service nova] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-42dc4552-616f-45a6-a87e-ee403b49d7ad req-a3f498d5-bc57-427e-b182-b383d4d0ee2f service nova] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-42dc4552-616f-45a6-a87e-ee403b49d7ad req-a3f498d5-bc57-427e-b182-b383d4d0ee2f service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] No waiting events found dispatching network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:41 user nova-compute[75215]: WARNING nova.compute.manager [req-42dc4552-616f-45a6-a87e-ee403b49d7ad req-a3f498d5-bc57-427e-b182-b383d4d0ee2f service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received unexpected event network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 for instance with vm_state building and task_state spawning.
Nov 11 01:46:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "34678116-4acb-438f-b14a-16459c723573" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:42 user nova-compute[75215]: INFO nova.compute.manager [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Shelving
Nov 11 01:46:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance destroyed successfully.
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Beginning cold snapshot process
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received event network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] No waiting events found dispatching network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:43 user nova-compute[75215]: WARNING nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received unexpected event network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 for instance with vm_state building and task_state spawning.
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:43 user nova-compute[75215]: WARNING nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:43 user nova-compute[75215]: WARNING nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:43 user nova-compute[75215]: WARNING nova.compute.manager [req-f1ca605b-05df-418c-b570-61237a0659a3 req-933395be-fc8f-444d-8605-d446380fd3b7 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 11 01:46:43 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk /opt/stack/data/nova/instances/snapshots/tmpkpwf_o98/e1d99f151d6043a5a032fa5e83e06842 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:46:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Instance spawned successfully.
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:44 user nova-compute[75215]: INFO nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 11 01:46:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:46:44 user nova-compute[75215]: INFO nova.compute.manager [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Took 8.22 seconds to build instance.
Nov 11 01:46:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6c8b5940-de0d-439a-9b4e-10f2c971ba63 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.382s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk /opt/stack/data/nova/instances/snapshots/tmpkpwf_o98/e1d99f151d6043a5a032fa5e83e06842" returned: 0 in 1.043s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Snapshot extracted, beginning image upload
Nov 11 01:46:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:45 user nova-compute[75215]: WARNING nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 01:46:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:45 user nova-compute[75215]: WARNING nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 01:46:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:46:45 user nova-compute[75215]: WARNING nova.compute.manager [req-32230915-9850-43bd-a182-acc909010b5c req-6c0c3117-3de9-4c0d-83c2-1f7f3a0da9bd service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 01:46:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Snapshot image upload complete
Nov 11 01:46:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:46:47 user nova-compute[75215]: INFO nova.compute.manager [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Shelve offloading
Nov 11 01:46:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance destroyed successfully.
Nov 11 01:46:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquired lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:46:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating instance_info_cache with network_info: [{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Releasing lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance destroyed successfully.
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.objects.instance [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'resources' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-934126155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-934126155',id=31,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFJcOSgaYf9+mZkYkxCrUGuCwgbtYACCzTwvkkfejrTLhFkXUkm/xvYjqPtTcwDDcbXKKS0+8uzbi3Uavxrcs1Lk2l9AbCd0/2kPIJxp+JtETMO9p/rfjYVv3PHVhxPww==',key_name='tempest-keypair-848868881',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:44:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-n9wqxq0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member',shelved_at='2023-11-11T01:46:47.671413',shelved_host='user',shelved_image_id='de5d0b1f-0a29-4985-a4fb-414d36947296'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:46:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=34678116-4acb-438f-b14a-16459c723573,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG os_vif [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6d90c48-0e, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-d65482a9-82a4-4350-b882-22084d3ce449 req-e87dbbef-4765-4820-b5f8-53ad466dace8 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-changed-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-d65482a9-82a4-4350-b882-22084d3ce449 req-e87dbbef-4765-4820-b5f8-53ad466dace8 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Refreshing instance network info cache due to event network-changed-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d65482a9-82a4-4350-b882-22084d3ce449 req-e87dbbef-4765-4820-b5f8-53ad466dace8 service nova] Acquiring lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d65482a9-82a4-4350-b882-22084d3ce449 req-e87dbbef-4765-4820-b5f8-53ad466dace8 service nova] Acquired lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-d65482a9-82a4-4350-b882-22084d3ce449 req-e87dbbef-4765-4820-b5f8-53ad466dace8 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Refreshing network info cache for port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7023e58-cfcc-4d48-8b29-0fdb310fdd20) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:46:49 user nova-compute[75215]: INFO os_vif [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e')
Nov 11 01:46:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Deleting instance files /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573_del
Nov 11 01:46:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Deletion of /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573_del complete
Nov 11 01:46:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:49 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Deleted allocations for instance 34678116-4acb-438f-b14a-16459c723573
Nov 11 01:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.objects.instance [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'numa_topology' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:46:49 user nova-compute[75215]: DEBUG nova.objects.base [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<34678116-4acb-438f-b14a-16459c723573> lazy-loaded attributes: resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:46:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-d65482a9-82a4-4350-b882-22084d3ce449 req-e87dbbef-4765-4820-b5f8-53ad466dace8 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Updated VIF entry in instance network info cache for port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:46:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-d65482a9-82a4-4350-b882-22084d3ce449 req-e87dbbef-4765-4820-b5f8-53ad466dace8 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating instance_info_cache with network_info: [{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d65482a9-82a4-4350-b882-22084d3ce449 req-e87dbbef-4765-4820-b5f8-53ad466dace8 service nova] Releasing lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:46:50 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:46:50 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-07a3d091-2fc9-459a-a85e-13bfe142bb37 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.056s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:46:51 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 is timed out.
Nov 11 01:46:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully detached device vdc from instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 from the live domain config.
Nov 11 01:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGpKdPYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:46:51 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ef6f7c-c5fd-47a4-af3e-6237c811facc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:46:51 user nova-compute[75215]: No targets found.
Nov 11 01:46:51 user nova-compute[75215]: iSNS:
Nov 11 01:46:51 user nova-compute[75215]: No targets found.
Nov 11 01:46:51 user nova-compute[75215]: STATIC:
Nov 11 01:46:51 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84
Nov 11 01:46:51 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:51 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:51 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e
Nov 11 01:46:51 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:51 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:51 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9
Nov 11 01:46:51 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:51 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:51 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:46:51 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:51 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:51 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971
Nov 11 01:46:51 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:46:51 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:46:51 user nova-compute[75215]: FIRMWARE:
Nov 11 01:46:51 user nova-compute[75215]: No targets found.
Nov 11 01:46:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:46:51 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:46:51 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[05834361-2419-4d9d-87ff-7b7e1137c157]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae229fa1-df6d-4d80-8d69-75d4a7c8fda5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:51 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:51 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:51 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:51 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)
Nov 11 01:46:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:46:51 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:46:51 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:46:51 user nova-compute[75215]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 (non-flash)
Nov 11 01:46:51 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)
Nov 11 01:46:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404421e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b104418-d9f1-4e7f-9a7c-4d26cb1abf05]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0832c170-e9ae-4c81-a72b-3ec60c8d0cf0]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a346cb-1ca0-4d3f-a6d1-190f56822c20]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88eee55-11c3-4aa6-ab2a-de510e4d7ecc]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f458d0-a508-4533-8954-d0e6754415b2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0bfbdc-e3db-49f3-b026-97c65a7f6ada]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971, portal: 172.16.0.220,3260]
Nov 11 01:46:51 user nova-compute[75215]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971, portal: 172.16.0.220,3260] successful.
Nov 11 01:46:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bb3d2a-a250-484c-b523-675ec7db5971 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c65d659-4ad6-4119-b197-98c55edf97af]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] <== disconnect_volume: return (360ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:46:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:46:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:46:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:00 user nova-compute[75215]: DEBUG nova.objects.instance [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'flavor' on Instance uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:47:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-51e98b29-bc05-423a-bd83-75a1a5200bd6 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.705s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:01 user nova-compute[75215]: INFO nova.compute.manager [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Terminating instance
Nov 11 01:47:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf258f01-2498-42f1-838c-bca2c6029f60 req-9573826f-38ae-47e9-950f-52b76abbb4ae service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-unplugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf258f01-2498-42f1-838c-bca2c6029f60 req-9573826f-38ae-47e9-950f-52b76abbb4ae service nova] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf258f01-2498-42f1-838c-bca2c6029f60 req-9573826f-38ae-47e9-950f-52b76abbb4ae service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf258f01-2498-42f1-838c-bca2c6029f60 req-9573826f-38ae-47e9-950f-52b76abbb4ae service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf258f01-2498-42f1-838c-bca2c6029f60 req-9573826f-38ae-47e9-950f-52b76abbb4ae service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] No waiting events found dispatching network-vif-unplugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf258f01-2498-42f1-838c-bca2c6029f60 req-9573826f-38ae-47e9-950f-52b76abbb4ae service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-unplugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Instance destroyed successfully.
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lazy-loading 'resources' on Instance uuid 19d13739-5512-48f7-a79c-d5b87fb9cc78 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1417432124',display_name='tempest-AttachVolumeTestJSON-server-1417432124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1417432124',id=28,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9pEXZ9fcRYxQz9n0tU7qAKxup3/F7Ma4Du+bBxN3a2wuwvGOzZFPTpRVVacPjJQYGm83rAGtm0oKS/dy/uThhQE2gWAolwHWNUzAh7P8vX+cPHHJC38xViW+Ei3k8nKQ==',key_name='tempest-keypair-766777034',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:41:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71c4317ced540a1a841f41cb9929b7b',ramdisk_id='',reservation_id='r-uv1a6r22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1999559004',owner_user_name='tempest-AttachVolumeTestJSON-1999559004-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:42:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285cd483fbdc4e4faec7a1bbd414ca7f',uuid=19d13739-5512-48f7-a79c-d5b87fb9cc78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converting VIF {"id": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "address": "fa:16:3e:d8:8e:90", "network": {"id": "e82aa910-f616-4fbd-81b2-c79465a5e89b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1925530977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71c4317ced540a1a841f41cb9929b7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2482e1e9-07", "ovs_interfaceid": "2482e1e9-0789-46f8-a0c1-db7b0c189d46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=2482e1e9-0789-46f8-a0c1-db7b0c189d46,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2482e1e9-07') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG os_vif [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=2482e1e9-0789-46f8-a0c1-db7b0c189d46,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2482e1e9-07') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2482e1e9-07, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99e20ee7-8799-44d0-be8f-a660c275bf1d) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: INFO os_vif [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=2482e1e9-0789-46f8-a0c1-db7b0c189d46,network=Network(e82aa910-f616-4fbd-81b2-c79465a5e89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2482e1e9-07')
Nov 11 01:47:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Deleting instance files /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78_del
Nov 11 01:47:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Deletion of /opt/stack/data/nova/instances/19d13739-5512-48f7-a79c-d5b87fb9cc78_del complete
Nov 11 01:47:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:02 user nova-compute[75215]: INFO nova.compute.manager [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 11 01:47:02 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:47:02 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:47:03 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Took 0.79 seconds to deallocate network for instance.
Nov 11 01:47:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-eb04d922-030a-49b2-b108-9481793887a2 req-dfa81721-23e8-4cef-a9c4-ec6a8f4b4158 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-deleted-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:03 user nova-compute[75215]: INFO nova.compute.manager [req-eb04d922-030a-49b2-b108-9481793887a2 req-dfa81721-23e8-4cef-a9c4-ec6a8f4b4158 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Neutron deleted interface 2482e1e9-0789-46f8-a0c1-db7b0c189d46; detaching it from the instance and deleting it from the info cache
Nov 11 01:47:03 user nova-compute[75215]: DEBUG nova.network.neutron [req-eb04d922-030a-49b2-b108-9481793887a2 req-dfa81721-23e8-4cef-a9c4-ec6a8f4b4158 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-eb04d922-030a-49b2-b108-9481793887a2 req-dfa81721-23e8-4cef-a9c4-ec6a8f4b4158 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Detach interface failed, port_id=2482e1e9-0789-46f8-a0c1-db7b0c189d46, reason: Instance 19d13739-5512-48f7-a79c-d5b87fb9cc78 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:04 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Deleted allocations for instance 19d13739-5512-48f7-a79c-d5b87fb9cc78
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a6509d60-dca6-4ac0-85d4-e93c9a1a3647 tempest-AttachVolumeTestJSON-1999559004 tempest-AttachVolumeTestJSON-1999559004-project-member] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.266s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] No waiting events found dispatching network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:04 user nova-compute[75215]: WARNING nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received unexpected event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 for instance with vm_state deleted and task_state None.
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] No waiting events found dispatching network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:04 user nova-compute[75215]: WARNING nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received unexpected event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 for instance with vm_state deleted and task_state None.
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] No waiting events found dispatching network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:04 user nova-compute[75215]: WARNING nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received unexpected event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 for instance with vm_state deleted and task_state None.
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-unplugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] No waiting events found dispatching network-vif-unplugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:04 user nova-compute[75215]: WARNING nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received unexpected event network-vif-unplugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 for instance with vm_state deleted and task_state None.
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Acquiring lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] Lock "19d13739-5512-48f7-a79c-d5b87fb9cc78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] No waiting events found dispatching network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:04 user nova-compute[75215]: WARNING nova.compute.manager [req-0ad4e15c-48b0-469d-bc4e-327507e82470 req-4573ba0c-457f-4e64-8600-2e05f2d94243 service nova] [instance: 19d13739-5512-48f7-a79c-d5b87fb9cc78] Received unexpected event network-vif-plugged-2482e1e9-0789-46f8-a0c1-db7b0c189d46 for instance with vm_state deleted and task_state None.
Nov 11 01:47:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:16 user nova-compute[75215]: INFO nova.compute.manager [None req-a91d5e09-945b-4416-bfc0-9a6d4b0da72a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Get console output
Nov 11 01:47:16 user nova-compute[75215]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 11 01:47:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:47:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:24 user nova-compute[75215]: INFO nova.compute.manager [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Detaching volume cb503f8d-6823-436f-8a97-dd7a416b0b84
Nov 11 01:47:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:47:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7276MB free_disk=25.05063247680664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:25 user nova-compute[75215]: INFO nova.virt.block_device [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attempting to driver detach volume cb503f8d-6823-436f-8a97-dd7a416b0b84 from mountpoint /dev/vdb
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Attempting to detach device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:47:25 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:47:25 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:47:25 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:47:25 user nova-compute[75215]:   <serial>cb503f8d-6823-436f-8a97-dd7a416b0b84</serial>
Nov 11 01:47:25 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:47:25 user nova-compute[75215]: </disk>
Nov 11 01:47:25 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:47:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully detached device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the persistent domain config.
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:47:25 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:47:25 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:47:25 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:47:25 user nova-compute[75215]:   <serial>cb503f8d-6823-436f-8a97-dd7a416b0b84</serial>
Nov 11 01:47:25 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:47:25 user nova-compute[75215]: </disk>
Nov 11 01:47:25 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 298c4f12-029f-407a-a71f-d5c722655f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance cd88426d-bcc9-4004-855f-a8d5b540ef55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:47:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:47:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:47:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:47:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:47:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:47:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updating instance_info_cache with network_info: [{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:47:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:47:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:47:31 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:31 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:31 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:31 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:47:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:47:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:47:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:47:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:47:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:47:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:47:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:47:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:45 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff69af94-7f3b-4851-a36b-a351fe838c66 is timed out.
Nov 11 01:47:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully detached device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the live domain config.
Nov 11 01:47:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuvrSwbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:47:45 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6275182e-f0e0-439c-8160-5396ef802290]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:47:45 user nova-compute[75215]: No targets found.
Nov 11 01:47:45 user nova-compute[75215]: iSNS:
Nov 11 01:47:45 user nova-compute[75215]: No targets found.
Nov 11 01:47:45 user nova-compute[75215]: STATIC:
Nov 11 01:47:45 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84
Nov 11 01:47:45 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:47:45 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:47:45 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e
Nov 11 01:47:45 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:47:45 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:47:45 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9
Nov 11 01:47:45 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:47:45 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:47:45 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:47:45 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:47:45 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:47:45 user nova-compute[75215]: FIRMWARE:
Nov 11 01:47:45 user nova-compute[75215]: No targets found.
Nov 11 01:47:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:47:45 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:47:45 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d80c3e6-d1c9-43f5-a8b7-eec77735acc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e0a86a-9a79-463e-bb32-36b703d4bfa1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:47:45 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:47:45 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:47:45 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)
Nov 11 01:47:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:47:45 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:47:45 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:47:45 user nova-compute[75215]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 (non-flash)
Nov 11 01:47:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404435fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f969fa1c-2b3d-4e38-9626-add97da7a8fc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aa1594-9f82-4a96-8049-79410cf05254]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[63524b44-6a53-436c-a550-44b204940137]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.071s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a6027-c8ec-41a7-b3ea-9d3b8a5580b0]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2099acd5-9c2a-4764-9a2f-56f29727969c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef714525-0e60-4767-847e-57f58a700f32]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84, portal: 172.16.0.220,3260]
Nov 11 01:47:45 user nova-compute[75215]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84, portal: 172.16.0.220,3260] successful.
Nov 11 01:47:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:47:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:47:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb503f8d-6823-436f-8a97-dd7a416b0b84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:47:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fbbbb7-4f26-4732-b4e1-5b7ddfc0c4dc]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:47:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:47:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:47:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== disconnect_volume: return (348ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:47:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:47:47 user nova-compute[75215]: INFO nova.compute.manager [None req-7bc74c1c-3265-4a49-b1c7-72571f5c3495 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Unrescuing
Nov 11 01:47:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7bc74c1c-3265-4a49-b1c7-72571f5c3495 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:47:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7bc74c1c-3265-4a49-b1c7-72571f5c3495 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquired lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:47:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7bc74c1c-3265-4a49-b1c7-72571f5c3495 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:47:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-7bc74c1c-3265-4a49-b1c7-72571f5c3495 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:47:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7bc74c1c-3265-4a49-b1c7-72571f5c3495 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Releasing lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:47:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7bc74c1c-3265-4a49-b1c7-72571f5c3495 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'flavor' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ea612c8-6aa4-4008-8663-38f951c56f22 req-ce402ae5-7d92-48c4-98c9-0264e4e77277 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ea612c8-6aa4-4008-8663-38f951c56f22 req-ce402ae5-7d92-48c4-98c9-0264e4e77277 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ea612c8-6aa4-4008-8663-38f951c56f22 req-ce402ae5-7d92-48c4-98c9-0264e4e77277 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8ea612c8-6aa4-4008-8663-38f951c56f22 req-ce402ae5-7d92-48c4-98c9-0264e4e77277 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-8ea612c8-6aa4-4008-8663-38f951c56f22 req-ce402ae5-7d92-48c4-98c9-0264e4e77277 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:48 user nova-compute[75215]: WARNING nova.compute.manager [req-8ea612c8-6aa4-4008-8663-38f951c56f22 req-ce402ae5-7d92-48c4-98c9-0264e4e77277 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance destroyed successfully.
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:50 user nova-compute[75215]: WARNING nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:50 user nova-compute[75215]: WARNING nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:50 user nova-compute[75215]: WARNING nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:50 user nova-compute[75215]: WARNING nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:50 user nova-compute[75215]: WARNING nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:50 user nova-compute[75215]: WARNING nova.compute.manager [req-ef13158e-c022-4ea0-b70b-7e51c29a00ca req-96b2954a-0caa-45b8-81c0-a9c58a0d4898 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:47:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7bc74c1c-3265-4a49-b1c7-72571f5c3495 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:47:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-3545ea3b-c427-492a-bbfe-066778b8e78d req-702e9d41-fb16-4cd4-b7be-b893c5d81bc5 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:47:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3545ea3b-c427-492a-bbfe-066778b8e78d req-702e9d41-fb16-4cd4-b7be-b893c5d81bc5 service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:47:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3545ea3b-c427-492a-bbfe-066778b8e78d req-702e9d41-fb16-4cd4-b7be-b893c5d81bc5 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:47:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3545ea3b-c427-492a-bbfe-066778b8e78d req-702e9d41-fb16-4cd4-b7be-b893c5d81bc5 service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:47:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-3545ea3b-c427-492a-bbfe-066778b8e78d req-702e9d41-fb16-4cd4-b7be-b893c5d81bc5 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:47:52 user nova-compute[75215]: WARNING nova.compute.manager [req-3545ea3b-c427-492a-bbfe-066778b8e78d req-702e9d41-fb16-4cd4-b7be-b893c5d81bc5 service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state active and task_state None.
Nov 11 01:47:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:47:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:48:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-090b1f9f-a24d-4ef3-9b18-23ed30b08382 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 44.099s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-eb1cb349-2e3c-478c-a606-bfc3a34031b1 req-2e1f9e9f-7340-42f8-b81a-113523a446f1 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Received event network-changed-2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-eb1cb349-2e3c-478c-a606-bfc3a34031b1 req-2e1f9e9f-7340-42f8-b81a-113523a446f1 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Refreshing instance network info cache due to event network-changed-2620e811-15ec-4d58-8c28-fdf9e3d871f8. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb1cb349-2e3c-478c-a606-bfc3a34031b1 req-2e1f9e9f-7340-42f8-b81a-113523a446f1 service nova] Acquiring lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:48:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb1cb349-2e3c-478c-a606-bfc3a34031b1 req-2e1f9e9f-7340-42f8-b81a-113523a446f1 service nova] Acquired lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:48:11 user nova-compute[75215]: DEBUG nova.network.neutron [req-eb1cb349-2e3c-478c-a606-bfc3a34031b1 req-2e1f9e9f-7340-42f8-b81a-113523a446f1 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Refreshing network info cache for port 2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-eb1cb349-2e3c-478c-a606-bfc3a34031b1 req-2e1f9e9f-7340-42f8-b81a-113523a446f1 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Updated VIF entry in instance network info cache for port 2620e811-15ec-4d58-8c28-fdf9e3d871f8. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-eb1cb349-2e3c-478c-a606-bfc3a34031b1 req-2e1f9e9f-7340-42f8-b81a-113523a446f1 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Updating instance_info_cache with network_info: [{"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-eb1cb349-2e3c-478c-a606-bfc3a34031b1 req-2e1f9e9f-7340-42f8-b81a-113523a446f1 service nova] Releasing lock "refresh_cache-2a264905-f5f0-46a9-9ccb-df09c0d6d534" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:12 user nova-compute[75215]: INFO nova.compute.manager [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Terminating instance
Nov 11 01:48:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Instance destroyed successfully.
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'resources' on Instance uuid 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1717157221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1717157221',id=27,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-oc54hq59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:46:28Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=7ac25219-b9e6-4698-b6e4-1d6c5653cfc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "address": "fa:16:3e:e5:e7:25", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79fc7525-cd", "ovs_interfaceid": "79fc7525-cd86-430b-a28f-40f2e0e6c0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e7:25,bridge_name='br-int',has_traffic_filtering=True,id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fc7525-cd') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_vif [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e7:25,bridge_name='br-int',has_traffic_filtering=True,id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fc7525-cd') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79fc7525-cd, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=723b27bc-c1e3-4ffb-8ead-c23d65c50cf0) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:13 user nova-compute[75215]: INFO os_vif [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e7:25,bridge_name='br-int',has_traffic_filtering=True,id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79fc7525-cd')
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJMBxgLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:48:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[34532eaf-7866-4036-8d7e-7cf3536637d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:48:13 user nova-compute[75215]: No targets found.
Nov 11 01:48:13 user nova-compute[75215]: iSNS:
Nov 11 01:48:13 user nova-compute[75215]: No targets found.
Nov 11 01:48:13 user nova-compute[75215]: STATIC:
Nov 11 01:48:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e
Nov 11 01:48:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:48:13 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:48:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9
Nov 11 01:48:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:48:13 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:48:13 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:48:13 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:48:13 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:48:13 user nova-compute[75215]: FIRMWARE:
Nov 11 01:48:13 user nova-compute[75215]: No targets found.
Nov 11 01:48:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:48:13 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:48:13 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[593169b0-fa81-41ed-a8b1-7673ddd7bd50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe67056-2682-4711-be9c-74c684d1b87d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:48:13 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:48:13 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:48:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:48:13 user nova-compute[75215]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 (non-flash)
Nov 11 01:48:13 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:48:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40640f9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f01e085-402a-4a02-a22f-36d8855f5761]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d4262-9bdd-4366-a01b-adaf91f33354]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76c53ba-23dc-4a2e-a920-016a60240190]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed8b015-a582-43de-9812-3eb459bd86ad]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8aeb318a', '/dev/disk/by-id/scsi-1SCST_BIO8aeb318a-0faeb8b6bc2b3c82', '/dev/disk/by-id/scsi-23066616562386236') {{(pid=86647) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[11992032-be62-4090-a99c-e308cd66c0e2]: (4, None) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcf1235-1b5e-48a2-9c17-6873e23c3662]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7283a6bf-1c59-46c6-b354-b234ee79b3d8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9, portal: 172.16.0.220,3260]
Nov 11 01:48:13 user nova-compute[75215]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9, portal: 172.16.0.220,3260] successful.
Nov 11 01:48:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa1398e5-6ecf-4aae-9962-62ad0736ade9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.098s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df53ce0-6a38-42c9-850a-d3d71e8623ff]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] <== disconnect_volume: return (450ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:48:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Deleting instance files /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9_del
Nov 11 01:48:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Deletion of /opt/stack/data/nova/instances/7ac25219-b9e6-4698-b6e4-1d6c5653cfc9_del complete
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-unplugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] Acquiring lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] No waiting events found dispatching network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:48:13 user nova-compute[75215]: WARNING nova.compute.manager [req-f462e2f0-92ab-4087-96aa-202f40a91165 req-bf3e3268-44fb-4219-892b-02a7958c7186 service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received unexpected event network-vif-plugged-79fc7525-cd86-430b-a28f-40f2e0e6c0fe for instance with vm_state active and task_state deleting.
Nov 11 01:48:14 user nova-compute[75215]: INFO nova.compute.manager [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 11 01:48:14 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:48:14 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:48:14 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:48:14 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:48:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:14 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Took 0.59 seconds to deallocate network for instance.
Nov 11 01:48:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-2fcaffe9-6e05-416d-b16e-a8d13f7b789f req-afea8ecf-62a1-4740-a501-d637336db29a service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Received event network-vif-deleted-79fc7525-cd86-430b-a28f-40f2e0e6c0fe {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:14 user nova-compute[75215]: INFO nova.compute.manager [req-2fcaffe9-6e05-416d-b16e-a8d13f7b789f req-afea8ecf-62a1-4740-a501-d637336db29a service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Neutron deleted interface 79fc7525-cd86-430b-a28f-40f2e0e6c0fe; detaching it from the instance and deleting it from the info cache
Nov 11 01:48:14 user nova-compute[75215]: DEBUG nova.network.neutron [req-2fcaffe9-6e05-416d-b16e-a8d13f7b789f req-afea8ecf-62a1-4740-a501-d637336db29a service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:48:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-2fcaffe9-6e05-416d-b16e-a8d13f7b789f req-afea8ecf-62a1-4740-a501-d637336db29a service nova] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Detach interface failed, port_id=79fc7525-cd86-430b-a28f-40f2e0e6c0fe, reason: Instance 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:16 user nova-compute[75215]: INFO nova.compute.manager [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Terminating instance
Nov 11 01:48:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:48:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-5eefb3b5-306c-409c-b6bb-bb55f2a0654a req-aab64c2c-1be9-4079-93e7-e240c9684cdc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5eefb3b5-306c-409c-b6bb-bb55f2a0654a req-aab64c2c-1be9-4079-93e7-e240c9684cdc service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5eefb3b5-306c-409c-b6bb-bb55f2a0654a req-aab64c2c-1be9-4079-93e7-e240c9684cdc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5eefb3b5-306c-409c-b6bb-bb55f2a0654a req-aab64c2c-1be9-4079-93e7-e240c9684cdc service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-5eefb3b5-306c-409c-b6bb-bb55f2a0654a req-aab64c2c-1be9-4079-93e7-e240c9684cdc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-5eefb3b5-306c-409c-b6bb-bb55f2a0654a req-aab64c2c-1be9-4079-93e7-e240c9684cdc service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-unplugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Instance destroyed successfully.
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.objects.instance [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'resources' on Instance uuid 298c4f12-029f-407a-a71f-d5c722655f8d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-538928176',display_name='tempest-ServerActionsTestOtherA-server-538928176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-538928176',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:44:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-tlmg4me0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=298c4f12-029f-407a-a71f-d5c722655f8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "404153aa-e572-4f64-a3c7-c474c6811610", "address": "fa:16:3e:7c:37:65", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404153aa-e5", "ovs_interfaceid": "404153aa-e572-4f64-a3c7-c474c6811610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_vif [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap404153aa-e5, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a6337ce-e0e5-4270-9fa3-95630829a4c0) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:48:17 user nova-compute[75215]: INFO os_vif [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:37:65,bridge_name='br-int',has_traffic_filtering=True,id=404153aa-e572-4f64-a3c7-c474c6811610,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404153aa-e5')
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGOIeEap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:48:17 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[39653b74-e9c4-4cf4-81bc-5832d1cca8a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:48:17 user nova-compute[75215]: No targets found.
Nov 11 01:48:17 user nova-compute[75215]: iSNS:
Nov 11 01:48:17 user nova-compute[75215]: No targets found.
Nov 11 01:48:17 user nova-compute[75215]: STATIC:
Nov 11 01:48:17 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e
Nov 11 01:48:17 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:48:17 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:48:17 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:48:17 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:48:17 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:48:17 user nova-compute[75215]: FIRMWARE:
Nov 11 01:48:17 user nova-compute[75215]: No targets found.
Nov 11 01:48:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:48:17 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:48:17 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ece3e3-c376-4934-a07e-aaa4935e8571]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7041b046-66f7-43c8-866c-2b48d2723da0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:48:17 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:48:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:48:17 user nova-compute[75215]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e (non-flash)
Nov 11 01:48:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4044308a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16fea18-8450-446e-a86f-08a0afad89b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11c8bff-337a-4185-a1cd-2009d5baeb0f]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fca853-26ea-4cd8-b0bd-3e346310bf20]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[551443bc-6243-4170-9f41-ec2b4f92ba61]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:48:17 user nova-compute[75215]: INFO nova.compute.manager [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9] Took 3.20 seconds to detach 1 volumes for instance.
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[895ea276-29af-424a-9a34-ab8587e70f5a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a15e2c-aa39-482a-8ad8-e93ecf3bea4b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260]
Nov 11 01:48:17 user nova-compute[75215]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e, portal: 172.16.0.220,3260] successful.
Nov 11 01:48:17 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42983526-ca9e-4973-8891-7830b5f2fc1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32b6637-90b5-4e49-8de1-c0ca7d60744b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] <== disconnect_volume: return (340ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:48:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:48:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Deleting instance files /opt/stack/data/nova/instances/298c4f12-029f-407a-a71f-d5c722655f8d_del
Nov 11 01:48:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Deletion of /opt/stack/data/nova/instances/298c4f12-029f-407a-a71f-d5c722655f8d_del complete
Nov 11 01:48:18 user nova-compute[75215]: INFO nova.compute.manager [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 11 01:48:18 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:48:18 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:48:18 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:48:18 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:48:18 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:48:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:18 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Deleted allocations for instance 7ac25219-b9e6-4698-b6e4-1d6c5653cfc9
Nov 11 01:48:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e195fde2-9d83-4636-b289-acc66a20db21 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "7ac25219-b9e6-4698-b6e4-1d6c5653cfc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.859s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:19 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:48:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a396b30-03f1-49e8-90f8-cae708eaab2d req-9a233d6d-4479-49ad-bf70-d0bae949e1e8 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a396b30-03f1-49e8-90f8-cae708eaab2d req-9a233d6d-4479-49ad-bf70-d0bae949e1e8 service nova] Acquiring lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a396b30-03f1-49e8-90f8-cae708eaab2d req-9a233d6d-4479-49ad-bf70-d0bae949e1e8 service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a396b30-03f1-49e8-90f8-cae708eaab2d req-9a233d6d-4479-49ad-bf70-d0bae949e1e8 service nova] Lock "298c4f12-029f-407a-a71f-d5c722655f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a396b30-03f1-49e8-90f8-cae708eaab2d req-9a233d6d-4479-49ad-bf70-d0bae949e1e8 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] No waiting events found dispatching network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:48:19 user nova-compute[75215]: WARNING nova.compute.manager [req-8a396b30-03f1-49e8-90f8-cae708eaab2d req-9a233d6d-4479-49ad-bf70-d0bae949e1e8 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received unexpected event network-vif-plugged-404153aa-e572-4f64-a3c7-c474c6811610 for instance with vm_state active and task_state deleting.
Nov 11 01:48:19 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Took 1.20 seconds to deallocate network for instance.
Nov 11 01:48:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb9b3996-074f-4fc1-9d04-ad31698dea53 req-070e0077-449b-45f6-b779-3bb84eee0fc2 service nova] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Received event network-vif-deleted-404153aa-e572-4f64-a3c7-c474c6811610 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:20 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:20 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:24 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:48:24 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:48:24 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7738MB free_disk=25.038150787353516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:48:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 298c4f12-029f-407a-a71f-d5c722655f8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance cd88426d-bcc9-4004-855f-a8d5b540ef55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:25 user nova-compute[75215]: INFO nova.compute.manager [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attaching volume 42c1e75a-5d19-4246-abb4-d0624b2a81fb to /dev/vdb
Nov 11 01:48:25 user nova-compute[75215]: DEBUG os_brick.utils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee78bb9-7117-4efc-aa1f-a3330626553e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e5d8ea-7a05-48f8-8fa7-0c1f6e66012d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[abda9394-1f6f-4243-a091-d6fcb0693e02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f188ab4-ec51-4025-8607-ed0b6b5c3487]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:48:25 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:48:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd31133-4a0e-4538-a168-bab6814be53a]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG os_brick.utils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:48:25 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating existing volume attachment record: a079eb41-c5de-4146-b885-58139b7cc01f {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:48:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-3348c544-9308-45d3-adf6-ef4a283d32f4 req-f7e99e1c-3eea-4115-bb1a-f910487fd27b service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received event network-changed-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-3348c544-9308-45d3-adf6-ef4a283d32f4 req-f7e99e1c-3eea-4115-bb1a-f910487fd27b service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Refreshing instance network info cache due to event network-changed-8e765a41-1fbf-4a36-a5a1-7229317c8538. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:48:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3348c544-9308-45d3-adf6-ef4a283d32f4 req-f7e99e1c-3eea-4115-bb1a-f910487fd27b service nova] Acquiring lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:48:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3348c544-9308-45d3-adf6-ef4a283d32f4 req-f7e99e1c-3eea-4115-bb1a-f910487fd27b service nova] Acquired lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:48:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-3348c544-9308-45d3-adf6-ef4a283d32f4 req-f7e99e1c-3eea-4115-bb1a-f910487fd27b service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Refreshing network info cache for port 8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:48:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-3348c544-9308-45d3-adf6-ef4a283d32f4 req-f7e99e1c-3eea-4115-bb1a-f910487fd27b service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Updated VIF entry in instance network info cache for port 8e765a41-1fbf-4a36-a5a1-7229317c8538. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-3348c544-9308-45d3-adf6-ef4a283d32f4 req-f7e99e1c-3eea-4115-bb1a-f910487fd27b service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Updating instance_info_cache with network_info: [{"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3348c544-9308-45d3-adf6-ef4a283d32f4 req-f7e99e1c-3eea-4115-bb1a-f910487fd27b service nova] Releasing lock "refresh_cache-cd88426d-bcc9-4004-855f-a8d5b540ef55" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lazy-loading 'flavor' on Instance uuid 2a264905-f5f0-46a9-9ccb-df09c0d6d534 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:28 user nova-compute[75215]: INFO nova.compute.manager [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Attaching volume b9c8163d-601e-4162-bed7-492694ce5ae2 to /dev/vdb
Nov 11 01:48:28 user nova-compute[75215]: DEBUG os_brick.utils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d46e0e-3746-44cc-b828-67304e7bc293]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57f46f8-2479-4601-aea6-4b903d3d4f0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5535c98-4670-4b36-97dd-6264ca3e5b8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e43036-f5d2-4268-90b1-d69c0b3c52c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:48:28 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:48:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ea68e8-abcb-4e61-81f1-3954cf733969]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG os_brick.utils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:48:28 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Updating existing volume attachment record: 08250a81-8da6-4de2-af76-72dde6efed40 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:48:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:31 user nova-compute[75215]: INFO nova.compute.manager [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Took 12.41 seconds to detach 1 volumes for instance.
Nov 11 01:48:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: 298c4f12-029f-407a-a71f-d5c722655f8d] Deleting volume: 42983526-ca9e-4973-8891-7830b5f2fc1e {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 01:48:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:32 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Deleted allocations for instance 298c4f12-029f-407a-a71f-d5c722655f8d
Nov 11 01:48:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-058f86be-2da2-45b8-9a8f-c7b4a391f73a tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "298c4f12-029f-407a-a71f-d5c722655f8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.621s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "34678116-4acb-438f-b14a-16459c723573" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:35 user nova-compute[75215]: INFO nova.compute.manager [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Unshelving
Nov 11 01:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG nova.objects.instance [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'pci_requests' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG nova.objects.instance [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'numa_topology' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:48:35 user nova-compute[75215]: INFO nova.compute.claims [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Claim successful on node user
Nov 11 01:48:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:48:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:35 user nova-compute[75215]: INFO nova.network.neutron [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 11 01:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquired lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:48:36 user nova-compute[75215]: DEBUG nova.network.neutron [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:48:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4449266-caf6-4128-9af9-f1f60a690bdb req-f423b402-1a36-41c7-8302-8812fe60e215 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-changed-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:36 user nova-compute[75215]: DEBUG nova.compute.manager [req-e4449266-caf6-4128-9af9-f1f60a690bdb req-f423b402-1a36-41c7-8302-8812fe60e215 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Refreshing instance network info cache due to event network-changed-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:48:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e4449266-caf6-4128-9af9-f1f60a690bdb req-f423b402-1a36-41c7-8302-8812fe60e215 service nova] Acquiring lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating instance_info_cache with network_info: [{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Releasing lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:48:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Creating image(s)
Nov 11 01:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG nova.objects.instance [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e4449266-caf6-4128-9af9-f1f60a690bdb req-f423b402-1a36-41c7-8302-8812fe60e215 service nova] Acquired lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4449266-caf6-4128-9af9-f1f60a690bdb req-f423b402-1a36-41c7-8302-8812fe60e215 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Refreshing network info cache for port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG nova.objects.base [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<34678116-4acb-438f-b14a-16459c723573> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "af6806dbad48584031918bd8a1f7b03e96b4b8bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "af6806dbad48584031918bd8a1f7b03e96b4b8bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG nova.virt.images [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] de5d0b1f-0a29-4985-a4fb-414d36947296 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf.part /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4449266-caf6-4128-9af9-f1f60a690bdb req-f423b402-1a36-41c7-8302-8812fe60e215 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Updated VIF entry in instance network info cache for port d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-e4449266-caf6-4128-9af9-f1f60a690bdb req-f423b402-1a36-41c7-8302-8812fe60e215 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating instance_info_cache with network_info: [{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:48:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e4449266-caf6-4128-9af9-f1f60a690bdb req-f423b402-1a36-41c7-8302-8812fe60e215 service nova] Releasing lock "refresh_cache-34678116-4acb-438f-b14a-16459c723573" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf.part /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf.converted" returned: 0 in 0.731s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf.converted --force-share --output=json" returned: 0 in 0.252s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "af6806dbad48584031918bd8a1f7b03e96b4b8bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.381s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "af6806dbad48584031918bd8a1f7b03e96b4b8bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "af6806dbad48584031918bd8a1f7b03e96b4b8bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf,backing_fmt=raw /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf,backing_fmt=raw /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk 1073741824" returned: 0 in 0.053s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "af6806dbad48584031918bd8a1f7b03e96b4b8bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf --force-share --output=json" returned: 0 in 0.204s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:40 user nova-compute[75215]: DEBUG nova.objects.instance [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'migration_context' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:40 user nova-compute[75215]: DEBUG nova.objects.base [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<34678116-4acb-438f-b14a-16459c723573> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:48:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Rebasing disk image.
Nov 11 01:48:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 -F raw /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 -F raw /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk" returned: 0 in 2.935s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Ensure instance console log exists: /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Start _get_guest_xml network_info=[{"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3f96e6c1fa85cd4b7b9a452ca2c89b38',container_format='bare',created_at=2023-11-11T01:46:42Z,direct_url=<?>,disk_format='qcow2',id=de5d0b1f-0a29-4985-a4fb-414d36947296,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-934126155-shelved',owner='739153e36b674c839c8d7bb97201e4aa',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T01:46:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:48:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:48:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3f96e6c1fa85cd4b7b9a452ca2c89b38',container_format='bare',created_at=2023-11-11T01:46:42Z,direct_url=<?>,disk_format='qcow2',id=de5d0b1f-0a29-4985-a4fb-414d36947296,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-934126155-shelved',owner='739153e36b674c839c8d7bb97201e4aa',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T01:46:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.objects.base [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<34678116-4acb-438f-b14a-16459c723573> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-934126155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-934126155',id=31,image_ref='de5d0b1f-0a29-4985-a4fb-414d36947296',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-848868881',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:44:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-n9wqxq0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member',shelved_at='2023-11-11T01:46:47.671413',shelved_host='user',shelved_image_id='de5d0b1f-0a29-4985-a4fb-414d36947296'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=34678116-4acb-438f-b14a-16459c723573,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'pci_devices' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.objects.base [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Object Instance<34678116-4acb-438f-b14a-16459c723573> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:48:43 user nova-compute[75215]:   <uuid>34678116-4acb-438f-b14a-16459c723573</uuid>
Nov 11 01:48:43 user nova-compute[75215]:   <name>instance-0000001f</name>
Nov 11 01:48:43 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:48:43 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:48:43 user nova-compute[75215]:   <metadata>
Nov 11 01:48:43 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:48:43 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:48:43 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-934126155</nova:name>
Nov 11 01:48:43 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:48:43</nova:creationTime>
Nov 11 01:48:43 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:48:43 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:48:43 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:48:43 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:48:43 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:48:43 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:48:43 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:48:43 user nova-compute[75215]:       <nova:owner>
Nov 11 01:48:43 user nova-compute[75215]:         <nova:user uuid="11c0895e92ca4572b6f004d360f18eaf">tempest-AttachVolumeShelveTestJSON-1029212070-project-member</nova:user>
Nov 11 01:48:43 user nova-compute[75215]:         <nova:project uuid="739153e36b674c839c8d7bb97201e4aa">tempest-AttachVolumeShelveTestJSON-1029212070</nova:project>
Nov 11 01:48:43 user nova-compute[75215]:       </nova:owner>
Nov 11 01:48:43 user nova-compute[75215]:       <nova:root type="image" uuid="de5d0b1f-0a29-4985-a4fb-414d36947296"/>
Nov 11 01:48:43 user nova-compute[75215]:       <nova:ports>
Nov 11 01:48:43 user nova-compute[75215]:         <nova:port uuid="d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac">
Nov 11 01:48:43 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 11 01:48:43 user nova-compute[75215]:         </nova:port>
Nov 11 01:48:43 user nova-compute[75215]:       </nova:ports>
Nov 11 01:48:43 user nova-compute[75215]:     </nova:instance>
Nov 11 01:48:43 user nova-compute[75215]:   </metadata>
Nov 11 01:48:43 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:48:43 user nova-compute[75215]:     <system>
Nov 11 01:48:43 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:48:43 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:48:43 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:48:43 user nova-compute[75215]:       <entry name="serial">34678116-4acb-438f-b14a-16459c723573</entry>
Nov 11 01:48:43 user nova-compute[75215]:       <entry name="uuid">34678116-4acb-438f-b14a-16459c723573</entry>
Nov 11 01:48:43 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:48:43 user nova-compute[75215]:     </system>
Nov 11 01:48:43 user nova-compute[75215]:   </sysinfo>
Nov 11 01:48:43 user nova-compute[75215]:   <os>
Nov 11 01:48:43 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:48:43 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:48:43 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:48:43 user nova-compute[75215]:   </os>
Nov 11 01:48:43 user nova-compute[75215]:   <features>
Nov 11 01:48:43 user nova-compute[75215]:     <acpi/>
Nov 11 01:48:43 user nova-compute[75215]:     <apic/>
Nov 11 01:48:43 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:48:43 user nova-compute[75215]:   </features>
Nov 11 01:48:43 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:48:43 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:48:43 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:48:43 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:48:43 user nova-compute[75215]:   </clock>
Nov 11 01:48:43 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:48:43 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:48:43 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:48:43 user nova-compute[75215]:   </cpu>
Nov 11 01:48:43 user nova-compute[75215]:   <devices>
Nov 11 01:48:43 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:48:43 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:48:43 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk"/>
Nov 11 01:48:43 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:48:43 user nova-compute[75215]:     </disk>
Nov 11 01:48:43 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:48:43 user nova-compute[75215]:       <mac address="fa:16:3e:d4:9e:9e"/>
Nov 11 01:48:43 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:48:43 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:48:43 user nova-compute[75215]:       <target dev="tapd6d90c48-0e"/>
Nov 11 01:48:43 user nova-compute[75215]:     </interface>
Nov 11 01:48:43 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:48:43 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/console.log" append="off"/>
Nov 11 01:48:43 user nova-compute[75215]:     </serial>
Nov 11 01:48:43 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:48:43 user nova-compute[75215]:     <video>
Nov 11 01:48:43 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:48:43 user nova-compute[75215]:     </video>
Nov 11 01:48:43 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:48:43 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:48:43 user nova-compute[75215]:     </rng>
Nov 11 01:48:43 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:48:43 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:48:43 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:48:43 user nova-compute[75215]:     </memballoon>
Nov 11 01:48:43 user nova-compute[75215]:   </devices>
Nov 11 01:48:43 user nova-compute[75215]: </domain>
Nov 11 01:48:43 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-934126155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-934126155',id=31,image_ref='de5d0b1f-0a29-4985-a4fb-414d36947296',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-848868881',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:44:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-n9wqxq0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member',shelved_at='2023-11-11T01:46:47.671413',shelved_host='user',shelved_image_id='de5d0b1f-0a29-4985-a4fb-414d36947296'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=34678116-4acb-438f-b14a-16459c723573,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG os_vif [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8332a487-f0be-5e90-8469-8f88bb8e7d71', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6d90c48-0e, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6d90c48-0e, col_values=(('qos', UUID('ea664be5-e98a-4db0-8bde-1d64b30a35eb')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6d90c48-0e, col_values=(('external_ids', {'iface-id': 'd6d90c48-0ee3-4fd6-9168-cfc2f979d8ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:9e:9e', 'vm-uuid': '34678116-4acb-438f-b14a-16459c723573'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:43 user nova-compute[75215]: INFO os_vif [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e')
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:48:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] No VIF found with MAC fa:16:3e:d4:9e:9e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:48:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-b86d8b97-f0c4-4853-b3b0-4870215b25a2 req-ae7b08d4-23d7-4c78-81de-4d144c11775d service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b86d8b97-f0c4-4853-b3b0-4870215b25a2 req-ae7b08d4-23d7-4c78-81de-4d144c11775d service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b86d8b97-f0c4-4853-b3b0-4870215b25a2 req-ae7b08d4-23d7-4c78-81de-4d144c11775d service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b86d8b97-f0c4-4853-b3b0-4870215b25a2 req-ae7b08d4-23d7-4c78-81de-4d144c11775d service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-b86d8b97-f0c4-4853-b3b0-4870215b25a2 req-ae7b08d4-23d7-4c78-81de-4d144c11775d service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:48:45 user nova-compute[75215]: WARNING nova.compute.manager [req-b86d8b97-f0c4-4853-b3b0-4870215b25a2 req-ae7b08d4-23d7-4c78-81de-4d144c11775d service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 01:48:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid cd88426d-bcc9-4004-855f-a8d5b540ef55 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-140760ff-9324-4bd8-9342-9d93a59b247c req-c4150f48-3db2-4c37-acf6-224305d6f44c service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-140760ff-9324-4bd8-9342-9d93a59b247c req-c4150f48-3db2-4c37-acf6-224305d6f44c service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-140760ff-9324-4bd8-9342-9d93a59b247c req-c4150f48-3db2-4c37-acf6-224305d6f44c service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-140760ff-9324-4bd8-9342-9d93a59b247c req-c4150f48-3db2-4c37-acf6-224305d6f44c service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-140760ff-9324-4bd8-9342-9d93a59b247c req-c4150f48-3db2-4c37-acf6-224305d6f44c service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:48:47 user nova-compute[75215]: WARNING nova.compute.manager [req-140760ff-9324-4bd8-9342-9d93a59b247c req-c4150f48-3db2-4c37-acf6-224305d6f44c service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 01:48:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:48:47 user nova-compute[75215]: INFO nova.compute.manager [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Attaching volume 688889fb-4003-412d-acdd-6712c070ca77 to /dev/vdb
Nov 11 01:48:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:48:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:48:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance spawned successfully.
Nov 11 01:48:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b301228-2d86-4cc6-8a77-810dd49d32cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[29008466-08ea-4066-b942-23f5e938b7e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc4000-eec8-4fee-aad1-42149ec170ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a9d2c5-5af7-4233-bb7c-00e939d437ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:48:48 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e53909-9f52-4cb2-b0b3-8e865642e378]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Updating existing volume attachment record: d598f05d-e7db-4c92-b995-c5c8d0e126ab {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-facaef6e-4bb7-4772-ab6e-df9322d747df tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.263s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:48:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:48:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:48:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:03 user nova-compute[75215]: INFO nova.compute.manager [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Terminating instance
Nov 11 01:49:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc53ba76-b7e5-4a43-86da-977cf2390385 req-10bc23ed-a3f2-4faa-91ff-9636ea374c7b service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received event network-vif-unplugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc53ba76-b7e5-4a43-86da-977cf2390385 req-10bc23ed-a3f2-4faa-91ff-9636ea374c7b service nova] Acquiring lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc53ba76-b7e5-4a43-86da-977cf2390385 req-10bc23ed-a3f2-4faa-91ff-9636ea374c7b service nova] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc53ba76-b7e5-4a43-86da-977cf2390385 req-10bc23ed-a3f2-4faa-91ff-9636ea374c7b service nova] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc53ba76-b7e5-4a43-86da-977cf2390385 req-10bc23ed-a3f2-4faa-91ff-9636ea374c7b service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] No waiting events found dispatching network-vif-unplugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc53ba76-b7e5-4a43-86da-977cf2390385 req-10bc23ed-a3f2-4faa-91ff-9636ea374c7b service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received event network-vif-unplugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Instance destroyed successfully.
Nov 11 01:49:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'resources' on Instance uuid 473f1cfa-fcac-4d21-99ee-bdb8140c315e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714858079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714858079',id=20,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:38:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-kc4fg0ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:40:48Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=473f1cfa-fcac-4d21-99ee-bdb8140c315e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "address": "fa:16:3e:e8:39:d5", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcacb3e5-47", "ovs_interfaceid": "fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:39:d5,bridge_name='br-int',has_traffic_filtering=True,id=fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcacb3e5-47') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG os_vif [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:39:d5,bridge_name='br-int',has_traffic_filtering=True,id=fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcacb3e5-47') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcacb3e5-47, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85a486bc-4b5e-452c-aede-c7d1a2b69236) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:04 user nova-compute[75215]: INFO os_vif [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:39:d5,bridge_name='br-int',has_traffic_filtering=True,id=fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcacb3e5-47')
Nov 11 01:49:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Deleting instance files /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e_del
Nov 11 01:49:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Deletion of /opt/stack/data/nova/instances/473f1cfa-fcac-4d21-99ee-bdb8140c315e_del complete
Nov 11 01:49:04 user nova-compute[75215]: INFO nova.compute.manager [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 11 01:49:04 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:49:04 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Took 0.47 seconds to deallocate network for instance.
Nov 11 01:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:05 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:49:05 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:49:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:05 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Deleted allocations for instance 473f1cfa-fcac-4d21-99ee-bdb8140c315e
Nov 11 01:49:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f2086ace-eb24-462a-9e79-e9e110f378a8 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.705s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-aca0b1c3-ca00-4f76-81d9-d357a0b61a23 req-db3c1a78-eaa0-4c7a-8a96-ab7a36f7968d service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received event network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aca0b1c3-ca00-4f76-81d9-d357a0b61a23 req-db3c1a78-eaa0-4c7a-8a96-ab7a36f7968d service nova] Acquiring lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aca0b1c3-ca00-4f76-81d9-d357a0b61a23 req-db3c1a78-eaa0-4c7a-8a96-ab7a36f7968d service nova] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-aca0b1c3-ca00-4f76-81d9-d357a0b61a23 req-db3c1a78-eaa0-4c7a-8a96-ab7a36f7968d service nova] Lock "473f1cfa-fcac-4d21-99ee-bdb8140c315e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-aca0b1c3-ca00-4f76-81d9-d357a0b61a23 req-db3c1a78-eaa0-4c7a-8a96-ab7a36f7968d service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] No waiting events found dispatching network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:49:05 user nova-compute[75215]: WARNING nova.compute.manager [req-aca0b1c3-ca00-4f76-81d9-d357a0b61a23 req-db3c1a78-eaa0-4c7a-8a96-ab7a36f7968d service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received unexpected event network-vif-plugged-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 for instance with vm_state deleted and task_state None.
Nov 11 01:49:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-aca0b1c3-ca00-4f76-81d9-d357a0b61a23 req-db3c1a78-eaa0-4c7a-8a96-ab7a36f7968d service nova] [instance: 473f1cfa-fcac-4d21-99ee-bdb8140c315e] Received event network-vif-deleted-fcacb3e5-47ab-4a20-8d15-c6de7e73ebc8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwLpvBfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:49:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:13 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:13 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dbca26-2ebc-4709-af7a-478d57ba953c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:49:13 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c05586-da0b-4948-99e8-7513c6744fa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77] added
Nov 11 01:49:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[851a1a0a-c137-4104-a484-9816d11415a1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[03867f91-e0f3-495b-b59d-a94275ea7afa]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RwLpvBfb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RwLpvBfb" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[064b6cf1-9944-4838-9cc0-c029cd6dc094]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RwLpvBfb'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aba1645-bb08-432b-b4c2-9bb21fc82426]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee780d-6d25-4d73-8d23-c447e0090806]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9024d05e-8966-4c07-a8e4-85b7945d58fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77, portal: 172.16.0.220,3260]
Nov 11 01:49:13 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77, portal: 172.16.0.220,3260] successful.
Nov 11 01:49:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c143a04c-2d34-416e-a416-b725d42a5c5f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5ddc1-b8f0-49b9-b7c2-9823a0016858]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:13 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:13 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:13 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:49:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cdd15d-ae57-4d1f-9e54-59b419477467]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:49:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwLpvBfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23938656631616163', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938656631616163', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid cd88426d-bcc9-4004-855f-a8d5b540ef55 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:49:15 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:15 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:49:15 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:15 user nova-compute[75215]:   <serial>688889fb-4003-412d-acdd-6712c070ca77</serial>
Nov 11 01:49:15 user nova-compute[75215]: </disk>
Nov 11 01:49:15 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No VIF found with MAC fa:16:3e:80:2a:6e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:49:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a8760e5a-ebe9-4a2d-bf81-3bd71da44f30 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.968s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:16 user nova-compute[75215]: INFO nova.compute.manager [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Detaching volume 688889fb-4003-412d-acdd-6712c070ca77
Nov 11 01:49:17 user nova-compute[75215]: INFO nova.virt.block_device [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Attempting to driver detach volume 688889fb-4003-412d-acdd-6712c070ca77 from mountpoint /dev/vdb
Nov 11 01:49:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Attempting to detach device vdb from instance cd88426d-bcc9-4004-855f-a8d5b540ef55 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:49:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:49:17 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:17 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:49:17 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:17 user nova-compute[75215]:   <serial>688889fb-4003-412d-acdd-6712c070ca77</serial>
Nov 11 01:49:17 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:49:17 user nova-compute[75215]: </disk>
Nov 11 01:49:17 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:49:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully detached device vdb from instance cd88426d-bcc9-4004-855f-a8d5b540ef55 from the persistent domain config.
Nov 11 01:49:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd88426d-bcc9-4004-855f-a8d5b540ef55 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:49:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:49:17 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:17 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:49:17 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:17 user nova-compute[75215]:   <serial>688889fb-4003-412d-acdd-6712c070ca77</serial>
Nov 11 01:49:17 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:49:17 user nova-compute[75215]: </disk>
Nov 11 01:49:17 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:49:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd88426d-bcc9-4004-855f-a8d5b540ef55 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:49:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:49:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:49:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:49:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7788MB free_disk=25.133358001708984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "ad403c50-a8fe-442f-9189-0a6925580739" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:26 user nova-compute[75215]: INFO nova.compute.manager [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Terminating instance
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ad403c50-a8fe-442f-9189-0a6925580739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance b372f84a-390e-4707-ad3c-8d9f0a7c8327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance cd88426d-bcc9-4004-855f-a8d5b540ef55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 34678116-4acb-438f-b14a-16459c723573 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-b698cd87-913c-4104-b5a5-4d318d374a19 req-e62ff490-50b9-46d4-8043-526cf6028ad7 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-vif-unplugged-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b698cd87-913c-4104-b5a5-4d318d374a19 req-e62ff490-50b9-46d4-8043-526cf6028ad7 service nova] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b698cd87-913c-4104-b5a5-4d318d374a19 req-e62ff490-50b9-46d4-8043-526cf6028ad7 service nova] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b698cd87-913c-4104-b5a5-4d318d374a19 req-e62ff490-50b9-46d4-8043-526cf6028ad7 service nova] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-b698cd87-913c-4104-b5a5-4d318d374a19 req-e62ff490-50b9-46d4-8043-526cf6028ad7 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] No waiting events found dispatching network-vif-unplugged-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:49:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-b698cd87-913c-4104-b5a5-4d318d374a19 req-e62ff490-50b9-46d4-8043-526cf6028ad7 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-vif-unplugged-544706ff-9665-4194-8957-4435ae082aac for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:27 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Instance destroyed successfully.
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.objects.instance [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lazy-loading 'resources' on Instance uuid ad403c50-a8fe-442f-9189-0a6925580739 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-976415081',display_name='tempest-ServerActionsTestOtherA-server-976415081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-976415081',id=5,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7oYzEkTm94xsAceesmJxn4p/QMl3dzlcpPqfE0TA9Imu8hVeLN4QcobVjK7RA5+scIm/N+2UYgUnAHDiBUBu96dV4zyxxitYvO1HCyKdOhZFc29thQ7lwEhBYFl3G/Bw==',key_name='tempest-keypair-399989166',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6fb80bd889f488bbfa25060dca25bb8',ramdisk_id='',reservation_id='r-gte8n3k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-802983068',owner_user_name='tempest-ServerActionsTestOtherA-802983068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:29:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e25bace5db43638b4eedfeb9215e24',uuid=ad403c50-a8fe-442f-9189-0a6925580739,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converting VIF {"id": "544706ff-9665-4194-8957-4435ae082aac", "address": "fa:16:3e:6a:57:12", "network": {"id": "f1fafe7a-db07-4604-86ec-102dac7d5719", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1630024766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb80bd889f488bbfa25060dca25bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544706ff-96", "ovs_interfaceid": "544706ff-9665-4194-8957-4435ae082aac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:57:12,bridge_name='br-int',has_traffic_filtering=True,id=544706ff-9665-4194-8957-4435ae082aac,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544706ff-96') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG os_vif [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:57:12,bridge_name='br-int',has_traffic_filtering=True,id=544706ff-9665-4194-8957-4435ae082aac,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544706ff-96') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap544706ff-96, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ce1490e-6e50-456d-82dc-bd6cf8bdcbff) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:27 user nova-compute[75215]: INFO os_vif [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:57:12,bridge_name='br-int',has_traffic_filtering=True,id=544706ff-9665-4194-8957-4435ae082aac,network=Network(f1fafe7a-db07-4604-86ec-102dac7d5719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544706ff-96')
Nov 11 01:49:27 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Deleting instance files /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739_del
Nov 11 01:49:27 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Deletion of /opt/stack/data/nova/instances/ad403c50-a8fe-442f-9189-0a6925580739_del complete
Nov 11 01:49:27 user nova-compute[75215]: INFO nova.compute.manager [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 11 01:49:27 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ad403c50-a8fe-442f-9189-0a6925580739] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:49:27 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Took 0.58 seconds to deallocate network for instance.
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-3f06cb51-b440-4229-97a3-91b8275dff99 req-d1550127-c863-45cc-9080-dc9665daa100 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-vif-deleted-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:27 user nova-compute[75215]: INFO nova.compute.manager [req-3f06cb51-b440-4229-97a3-91b8275dff99 req-d1550127-c863-45cc-9080-dc9665daa100 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Neutron deleted interface 544706ff-9665-4194-8957-4435ae082aac; detaching it from the instance and deleting it from the info cache
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.network.neutron [req-3f06cb51-b440-4229-97a3-91b8275dff99 req-d1550127-c863-45cc-9080-dc9665daa100 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-3f06cb51-b440-4229-97a3-91b8275dff99 req-d1550127-c863-45cc-9080-dc9665daa100 service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Detach interface failed, port_id=544706ff-9665-4194-8957-4435ae082aac, reason: Instance ad403c50-a8fe-442f-9189-0a6925580739 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:28 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Deleted allocations for instance ad403c50-a8fe-442f-9189-0a6925580739
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-274fdf9f-b5cb-4f1f-8d7c-50e11e6280c5 tempest-ServerActionsTestOtherA-802983068 tempest-ServerActionsTestOtherA-802983068-project-member] Lock "ad403c50-a8fe-442f-9189-0a6925580739" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.814s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldkoguM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:49:28 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:28 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:28 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:49:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-386dff6b-b50d-4be0-906f-6db76f7aa486 req-131b03bb-7cc4-4dc2-8bb9-b8040a0e512f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received event network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-386dff6b-b50d-4be0-906f-6db76f7aa486 req-131b03bb-7cc4-4dc2-8bb9-b8040a0e512f service nova] Acquiring lock "ad403c50-a8fe-442f-9189-0a6925580739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-386dff6b-b50d-4be0-906f-6db76f7aa486 req-131b03bb-7cc4-4dc2-8bb9-b8040a0e512f service nova] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-386dff6b-b50d-4be0-906f-6db76f7aa486 req-131b03bb-7cc4-4dc2-8bb9-b8040a0e512f service nova] Lock "ad403c50-a8fe-442f-9189-0a6925580739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-386dff6b-b50d-4be0-906f-6db76f7aa486 req-131b03bb-7cc4-4dc2-8bb9-b8040a0e512f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] No waiting events found dispatching network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:49:28 user nova-compute[75215]: WARNING nova.compute.manager [req-386dff6b-b50d-4be0-906f-6db76f7aa486 req-131b03bb-7cc4-4dc2-8bb9-b8040a0e512f service nova] [instance: ad403c50-a8fe-442f-9189-0a6925580739] Received unexpected event network-vif-plugged-544706ff-9665-4194-8957-4435ae082aac for instance with vm_state deleted and task_state None.
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93c8476-0836-4622-93aa-87a7a6dfdc2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:49:28 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0563207-d01b-473c-b024-e3628aa22587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb] added
Nov 11 01:49:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKIUoCjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:49:29 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d55dde5-f3ed-4d4e-848a-7195904416d7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ad8d1b-f706-47ab-a7e3-d1810de99b94]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TldkoguM {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TldkoguM" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4817aaef-6c3b-45d9-be52-1ab84eaa0c96]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TldkoguM'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c65868-e5c8-4fd0-b54e-ceba2b531879]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e0480-fd24-4c98-aa53-82cfb31cbf57]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:29 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:29 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aed596-276f-41eb-b6d9-0a5ec49e3860]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb, portal: 172.16.0.220,3260]
Nov 11 01:49:29 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb, portal: 172.16.0.220,3260] successful.
Nov 11 01:49:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[601df8e1-50db-43d0-88c6-888349604ba0]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[383f07ba-5e44-4010-8884-481b258f75dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:29 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:29 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:29 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:29 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd26993c-d77b-42dc-87ea-0553a4f44817]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:29 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldkoguM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26331363964313130', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331363964313130', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.259s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:30 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:30 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3643641f-6ea7-4df7-a33a-1993bafc3cfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:49:30 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:49:30 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:30 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:49:30 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:30 user nova-compute[75215]:   <serial>42c1e75a-5d19-4246-abb4-d0624b2a81fb</serial>
Nov 11 01:49:30 user nova-compute[75215]: </disk>
Nov 11 01:49:30 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67d9ee-9022-4091-a5ee-9a5187101e38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2] added
Nov 11 01:49:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58b108-a793-4daa-b0a3-56280da0d24c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[de13afde-c858-4bd8-82d1-dad212c04dec]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKIUoCjX {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKIUoCjX" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8fd6b6-f87e-49c0-b923-319075546d20]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WKIUoCjX'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9812430a-c3ae-48ce-9c88-954e978536db]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ec8119-763f-45e0-908b-998fb1efa1fc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92da766-2db3-4ae6-aa8e-2fa0fcdfdc66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2, portal: 172.16.0.220,3260]
Nov 11 01:49:30 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2, portal: 172.16.0.220,3260] successful.
Nov 11 01:49:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[980ee41d-3306-4f41-90c3-c4cf09d6b75f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc7cb6-dc0e-49d3-a56f-b172f883cb6a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:30 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b06d1-d2c0-4d54-80da-eff2b98175fe]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:49:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No VIF found with MAC fa:16:3e:fc:42:0d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:49:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-480dc1d8-b50e-4d8a-af1a-938e234f964b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.536s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:49:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKIUoCjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:49:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] <== connect_volume: return (2579ms) {'type': 'block', 'scsi_wwn': '23939626439333666', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939626439333666', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:49:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lazy-loading 'flavor' on Instance uuid 2a264905-f5f0-46a9-9ccb-df09c0d6d534 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:49:31 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:31 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:49:31 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:31 user nova-compute[75215]:   <serial>b9c8163d-601e-4162-bed7-492694ce5ae2</serial>
Nov 11 01:49:31 user nova-compute[75215]: </disk>
Nov 11 01:49:31 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:49:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:49:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:49:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] No VIF found with MAC fa:16:3e:76:fe:45, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e4946162-5026-4c5e-bbdc-0a2ae0d617d4 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 63.815s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:33 user nova-compute[75215]: INFO nova.compute.manager [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Detaching volume 42c1e75a-5d19-4246-abb4-d0624b2a81fb
Nov 11 01:49:33 user nova-compute[75215]: INFO nova.virt.block_device [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attempting to driver detach volume 42c1e75a-5d19-4246-abb4-d0624b2a81fb from mountpoint /dev/vdb
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Attempting to detach device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:49:33 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:33 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:49:33 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:33 user nova-compute[75215]:   <serial>42c1e75a-5d19-4246-abb4-d0624b2a81fb</serial>
Nov 11 01:49:33 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:49:33 user nova-compute[75215]: </disk>
Nov 11 01:49:33 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:49:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully detached device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the persistent domain config.
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:49:33 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:33 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:49:33 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:33 user nova-compute[75215]:   <serial>42c1e75a-5d19-4246-abb4-d0624b2a81fb</serial>
Nov 11 01:49:33 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:49:33 user nova-compute[75215]: </disk>
Nov 11 01:49:33 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 330defc6-9b43-4f1e-9a76-94b23750e1b0 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updating instance_info_cache with network_info: [{"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-330defc6-9b43-4f1e-9a76-94b23750e1b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:49:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:34 user nova-compute[75215]: INFO nova.compute.manager [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Detaching volume b9c8163d-601e-4162-bed7-492694ce5ae2
Nov 11 01:49:34 user nova-compute[75215]: INFO nova.virt.block_device [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Attempting to driver detach volume b9c8163d-601e-4162-bed7-492694ce5ae2 from mountpoint /dev/vdb
Nov 11 01:49:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Attempting to detach device vdb from instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:49:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:49:34 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:34 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:49:34 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:34 user nova-compute[75215]:   <serial>b9c8163d-601e-4162-bed7-492694ce5ae2</serial>
Nov 11 01:49:34 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:49:34 user nova-compute[75215]: </disk>
Nov 11 01:49:34 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:49:34 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Successfully detached device vdb from instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 from the persistent domain config.
Nov 11 01:49:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:49:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:49:34 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:49:34 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:49:34 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:49:34 user nova-compute[75215]:   <serial>b9c8163d-601e-4162-bed7-492694ce5ae2</serial>
Nov 11 01:49:34 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:49:34 user nova-compute[75215]: </disk>
Nov 11 01:49:34 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:49:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:49:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:37 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd88426d-bcc9-4004-855f-a8d5b540ef55 is timed out.
Nov 11 01:49:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully detached device vdb from instance cd88426d-bcc9-4004-855f-a8d5b540ef55 from the live domain config.
Nov 11 01:49:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwLpvBfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:49:37 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6130d77b-9f9f-484b-9911-5f02c86a225d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:49:37 user nova-compute[75215]: No targets found.
Nov 11 01:49:37 user nova-compute[75215]: iSNS:
Nov 11 01:49:37 user nova-compute[75215]: No targets found.
Nov 11 01:49:37 user nova-compute[75215]: STATIC:
Nov 11 01:49:37 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb
Nov 11 01:49:37 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:37 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:37 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:49:37 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:37 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:37 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2
Nov 11 01:49:37 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:37 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:37 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77
Nov 11 01:49:37 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:37 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:37 user nova-compute[75215]: FIRMWARE:
Nov 11 01:49:37 user nova-compute[75215]: No targets found.
Nov 11 01:49:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:49:37 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:49:37 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2835044c-c483-41fc-b02c-f7d640850a1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e5a76e-55ab-42f4-ab44-449f0147286d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:37 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:37 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:37 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:37 user nova-compute[75215]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 (non-flash)
Nov 11 01:49:37 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:37 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4020f26440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[21360b25-7b8e-4833-afae-c9f57a0a924b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefddaa3-5e2e-4e2f-820c-d89a8dc5b54e]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d05fc0e-0b76-4b59-bcf4-7d75adf5de86]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1810760-59cc-40cf-ac57-b4a731f9eaaf]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9799ba1f-91ca-4005-88a6-a95239502869]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b58a32-35c0-49a3-9f81-bd97c0d2f2d9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77, portal: 172.16.0.220,3260]
Nov 11 01:49:37 user nova-compute[75215]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77, portal: 172.16.0.220,3260] successful.
Nov 11 01:49:37 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:688889fb-4003-412d-acdd-6712c070ca77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ca302-12d3-4982-9a2c-149e3a242698]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== disconnect_volume: return (320ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:49:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:49:42 user nova-compute[75215]: DEBUG nova.objects.instance [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid cd88426d-bcc9-4004-855f-a8d5b540ef55 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-37b3037c-9ff9-46ba-94a9-115d6181eb8e tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.322s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:49:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:49:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:49:46 user nova-compute[75215]: INFO nova.compute.claims [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Claim successful on node user
Nov 11 01:49:46 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:49:46 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:49:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.policy [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c11f7630148412285910f06eade4923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddded455ac3456e9316603170bb6fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:49:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Creating image(s)
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk 1073741824" returned: 0 in 0.050s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Successfully created port: 6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:49:47 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Cannot resize image /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Ensure instance console log exists: /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Successfully updated port: 6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquired lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-4351b270-a1de-47e3-9210-bc231fae79e0 req-85f6011b-b34a-4aac-a573-878e010b2b0c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-changed-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-4351b270-a1de-47e3-9210-bc231fae79e0 req-85f6011b-b34a-4aac-a573-878e010b2b0c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Refreshing instance network info cache due to event network-changed-6cafb810-c1ab-420c-8d1d-810e0abd2a5d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4351b270-a1de-47e3-9210-bc231fae79e0 req-85f6011b-b34a-4aac-a573-878e010b2b0c service nova] Acquiring lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.neutron [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Releasing lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance network_info: |[{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4351b270-a1de-47e3-9210-bc231fae79e0 req-85f6011b-b34a-4aac-a573-878e010b2b0c service nova] Acquired lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.neutron [req-4351b270-a1de-47e3-9210-bc231fae79e0 req-85f6011b-b34a-4aac-a573-878e010b2b0c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Refreshing network info cache for port 6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Start _get_guest_xml network_info=[{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:49:48 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:49:48 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-145951852',display_name='tempest-ServerRescueNegativeTestJSON-server-145951852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-145951852',id=34,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ449/qav3FEPuXNzb1iK0CzVUc9Wq5/MUO/yH57h6uviMwlJ47BvlUggfmXkzfkhMtW4mAZA3J7v61jwqe9qKMJG/FyJJoZyrWaWQvWr/ZuKUYqdusyzxKd1lXCXImDVA==',key_name='tempest-keypair-2014465418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-h02sow4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c11f7630148412285910f06eade4923',uuid=180b30c6-7d87-44a6-ab5a-305fd8d20dbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b6:15,bridge_name='br-int',has_traffic_filtering=True,id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cafb810-c1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.objects.instance [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'pci_devices' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:49:48 user nova-compute[75215]:   <uuid>180b30c6-7d87-44a6-ab5a-305fd8d20dbd</uuid>
Nov 11 01:49:48 user nova-compute[75215]:   <name>instance-00000022</name>
Nov 11 01:49:48 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:49:48 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:49:48 user nova-compute[75215]:   <metadata>
Nov 11 01:49:48 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:49:48 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:49:48 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-145951852</nova:name>
Nov 11 01:49:48 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:49:48</nova:creationTime>
Nov 11 01:49:48 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:49:48 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:49:48 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:49:48 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:49:48 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:49:48 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:49:48 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:49:48 user nova-compute[75215]:       <nova:owner>
Nov 11 01:49:48 user nova-compute[75215]:         <nova:user uuid="2c11f7630148412285910f06eade4923">tempest-ServerRescueNegativeTestJSON-107483545-project-member</nova:user>
Nov 11 01:49:48 user nova-compute[75215]:         <nova:project uuid="dddded455ac3456e9316603170bb6fea">tempest-ServerRescueNegativeTestJSON-107483545</nova:project>
Nov 11 01:49:48 user nova-compute[75215]:       </nova:owner>
Nov 11 01:49:48 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:49:48 user nova-compute[75215]:       <nova:ports>
Nov 11 01:49:48 user nova-compute[75215]:         <nova:port uuid="6cafb810-c1ab-420c-8d1d-810e0abd2a5d">
Nov 11 01:49:48 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 01:49:48 user nova-compute[75215]:         </nova:port>
Nov 11 01:49:48 user nova-compute[75215]:       </nova:ports>
Nov 11 01:49:48 user nova-compute[75215]:     </nova:instance>
Nov 11 01:49:48 user nova-compute[75215]:   </metadata>
Nov 11 01:49:48 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:49:48 user nova-compute[75215]:     <system>
Nov 11 01:49:48 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:49:48 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:49:48 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:49:48 user nova-compute[75215]:       <entry name="serial">180b30c6-7d87-44a6-ab5a-305fd8d20dbd</entry>
Nov 11 01:49:48 user nova-compute[75215]:       <entry name="uuid">180b30c6-7d87-44a6-ab5a-305fd8d20dbd</entry>
Nov 11 01:49:48 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:49:48 user nova-compute[75215]:     </system>
Nov 11 01:49:48 user nova-compute[75215]:   </sysinfo>
Nov 11 01:49:48 user nova-compute[75215]:   <os>
Nov 11 01:49:48 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:49:48 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:49:48 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:49:48 user nova-compute[75215]:   </os>
Nov 11 01:49:48 user nova-compute[75215]:   <features>
Nov 11 01:49:48 user nova-compute[75215]:     <acpi/>
Nov 11 01:49:48 user nova-compute[75215]:     <apic/>
Nov 11 01:49:48 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:49:48 user nova-compute[75215]:   </features>
Nov 11 01:49:48 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:49:48 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:49:48 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:49:48 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:49:48 user nova-compute[75215]:   </clock>
Nov 11 01:49:48 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:49:48 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:49:48 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:49:48 user nova-compute[75215]:   </cpu>
Nov 11 01:49:48 user nova-compute[75215]:   <devices>
Nov 11 01:49:48 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:49:48 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:49:48 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk"/>
Nov 11 01:49:48 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:49:48 user nova-compute[75215]:     </disk>
Nov 11 01:49:48 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:49:48 user nova-compute[75215]:       <mac address="fa:16:3e:b9:b6:15"/>
Nov 11 01:49:48 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:49:48 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:49:48 user nova-compute[75215]:       <target dev="tap6cafb810-c1"/>
Nov 11 01:49:48 user nova-compute[75215]:     </interface>
Nov 11 01:49:48 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:49:48 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/console.log" append="off"/>
Nov 11 01:49:48 user nova-compute[75215]:     </serial>
Nov 11 01:49:48 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:49:48 user nova-compute[75215]:     <video>
Nov 11 01:49:48 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:49:48 user nova-compute[75215]:     </video>
Nov 11 01:49:48 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:49:48 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:49:48 user nova-compute[75215]:     </rng>
Nov 11 01:49:48 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:49:48 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:49:48 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:49:48 user nova-compute[75215]:     </memballoon>
Nov 11 01:49:48 user nova-compute[75215]:   </devices>
Nov 11 01:49:48 user nova-compute[75215]: </domain>
Nov 11 01:49:48 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-145951852',display_name='tempest-ServerRescueNegativeTestJSON-server-145951852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-145951852',id=34,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ449/qav3FEPuXNzb1iK0CzVUc9Wq5/MUO/yH57h6uviMwlJ47BvlUggfmXkzfkhMtW4mAZA3J7v61jwqe9qKMJG/FyJJoZyrWaWQvWr/ZuKUYqdusyzxKd1lXCXImDVA==',key_name='tempest-keypair-2014465418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-h02sow4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c11f7630148412285910f06eade4923',uuid=180b30c6-7d87-44a6-ab5a-305fd8d20dbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b6:15,bridge_name='br-int',has_traffic_filtering=True,id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cafb810-c1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG os_vif [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b6:15,bridge_name='br-int',has_traffic_filtering=True,id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cafb810-c1') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f6ad323-44a2-59a6-ad6a-7ad6cf9bd8b7', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cafb810-c1, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cafb810-c1, col_values=(('qos', UUID('0c6a8189-4ac9-4b2b-bd71-e34150f1c104')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cafb810-c1, col_values=(('external_ids', {'iface-id': '6cafb810-c1ab-420c-8d1d-810e0abd2a5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:b6:15', 'vm-uuid': '180b30c6-7d87-44a6-ab5a-305fd8d20dbd'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:49 user nova-compute[75215]: INFO os_vif [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b6:15,bridge_name='br-int',has_traffic_filtering=True,id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cafb810-c1')
Nov 11 01:49:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No VIF found with MAC fa:16:3e:b9:b6:15, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-4351b270-a1de-47e3-9210-bc231fae79e0 req-85f6011b-b34a-4aac-a573-878e010b2b0c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updated VIF entry in instance network info cache for port 6cafb810-c1ab-420c-8d1d-810e0abd2a5d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-4351b270-a1de-47e3-9210-bc231fae79e0 req-85f6011b-b34a-4aac-a573-878e010b2b0c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:49:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4351b270-a1de-47e3-9210-bc231fae79e0 req-85f6011b-b34a-4aac-a573-878e010b2b0c service nova] Releasing lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-d03fa30a-558c-49a2-ab43-e5a010132822 req-d46806ac-214e-4c8d-93ca-ab5a3cd11664 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d03fa30a-558c-49a2-ab43-e5a010132822 req-d46806ac-214e-4c8d-93ca-ab5a3cd11664 service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d03fa30a-558c-49a2-ab43-e5a010132822 req-d46806ac-214e-4c8d-93ca-ab5a3cd11664 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d03fa30a-558c-49a2-ab43-e5a010132822 req-d46806ac-214e-4c8d-93ca-ab5a3cd11664 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-d03fa30a-558c-49a2-ab43-e5a010132822 req-d46806ac-214e-4c8d-93ca-ab5a3cd11664 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:49:50 user nova-compute[75215]: WARNING nova.compute.manager [req-d03fa30a-558c-49a2-ab43-e5a010132822 req-d46806ac-214e-4c8d-93ca-ab5a3cd11664 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state building and task_state spawning.
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:49:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance spawned successfully.
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:49:52 user nova-compute[75215]: INFO nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:49:52 user nova-compute[75215]: INFO nova.compute.manager [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Took 6.14 seconds to build instance.
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-0f538260-1e81-46d3-b2f2-074dcd2fb9bf req-ba47a9d6-2131-4a9b-9a14-67b29575cfb5 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0f538260-1e81-46d3-b2f2-074dcd2fb9bf req-ba47a9d6-2131-4a9b-9a14-67b29575cfb5 service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0f538260-1e81-46d3-b2f2-074dcd2fb9bf req-ba47a9d6-2131-4a9b-9a14-67b29575cfb5 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0f538260-1e81-46d3-b2f2-074dcd2fb9bf req-ba47a9d6-2131-4a9b-9a14-67b29575cfb5 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-0f538260-1e81-46d3-b2f2-074dcd2fb9bf req-ba47a9d6-2131-4a9b-9a14-67b29575cfb5 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:49:52 user nova-compute[75215]: WARNING nova.compute.manager [req-0f538260-1e81-46d3-b2f2-074dcd2fb9bf req-ba47a9d6-2131-4a9b-9a14-67b29575cfb5 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state active and task_state None.
Nov 11 01:49:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-dc715a1a-4878-4259-9a0d-59c52845cdfa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.261s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff69af94-7f3b-4851-a36b-a351fe838c66 is timed out.
Nov 11 01:49:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully detached device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the live domain config.
Nov 11 01:49:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldkoguM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:49:53 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff65f6f-33d6-494d-8b7b-cc242e576db6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:49:53 user nova-compute[75215]: No targets found.
Nov 11 01:49:53 user nova-compute[75215]: iSNS:
Nov 11 01:49:53 user nova-compute[75215]: No targets found.
Nov 11 01:49:53 user nova-compute[75215]: STATIC:
Nov 11 01:49:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb
Nov 11 01:49:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:53 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:49:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:53 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:53 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2
Nov 11 01:49:53 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:53 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:53 user nova-compute[75215]: FIRMWARE:
Nov 11 01:49:53 user nova-compute[75215]: No targets found.
Nov 11 01:49:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:49:53 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:49:53 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace020c-04c4-4751-b8c2-c96d20392d2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cbb715-2343-42d8-8f9e-6b90e400bf07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:53 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:53 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:53 user nova-compute[75215]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb (non-flash)
Nov 11 01:49:53 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40442a6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f8cff8-cdcc-4196-bb56-b87ed9ef95a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d9907d-7c9e-4a64-8632-dcd2ba16c003]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e7db09-c708-478b-a5ff-f8fd442cd18d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[687199a8-52ad-443a-9142-7bab0689ba6e]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[da921b91-288a-4a4d-bf6a-8bae14976cb7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23eb900-2fa1-424b-97ff-7909438e4aab]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb, portal: 172.16.0.220,3260]
Nov 11 01:49:53 user nova-compute[75215]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb, portal: 172.16.0.220,3260] successful.
Nov 11 01:49:53 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c1e75a-5d19-4246-abb4-d0624b2a81fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f5a5f1-30af-4cbd-8f3e-fef68cae382e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== disconnect_volume: return (332ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:49:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:54 user nova-compute[75215]: INFO nova.compute.manager [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Terminating instance
Nov 11 01:49:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-94c5c558-c89e-4ec2-8a11-df19d4711913 req-15dc7aac-ca42-4b99-b735-30e4276fb5c9 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94c5c558-c89e-4ec2-8a11-df19d4711913 req-15dc7aac-ca42-4b99-b735-30e4276fb5c9 service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94c5c558-c89e-4ec2-8a11-df19d4711913 req-15dc7aac-ca42-4b99-b735-30e4276fb5c9 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94c5c558-c89e-4ec2-8a11-df19d4711913 req-15dc7aac-ca42-4b99-b735-30e4276fb5c9 service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-94c5c558-c89e-4ec2-8a11-df19d4711913 req-15dc7aac-ca42-4b99-b735-30e4276fb5c9 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-94c5c558-c89e-4ec2-8a11-df19d4711913 req-15dc7aac-ca42-4b99-b735-30e4276fb5c9 service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-unplugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Instance destroyed successfully.
Nov 11 01:49:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'resources' on Instance uuid b372f84a-390e-4707-ad3c-8d9f0a7c8327 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2103065644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2103065644',id=13,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-len87ys3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:37:02Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=b372f84a-390e-4707-ad3c-8d9f0a7c8327,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "427d21a8-099b-4a97-8428-39ba7ed4d384", "address": "fa:16:3e:61:e5:81", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427d21a8-09", "ovs_interfaceid": "427d21a8-099b-4a97-8428-39ba7ed4d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:e5:81,bridge_name='br-int',has_traffic_filtering=True,id=427d21a8-099b-4a97-8428-39ba7ed4d384,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427d21a8-09') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:49:54 user nova-compute[75215]: DEBUG os_vif [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:e5:81,bridge_name='br-int',has_traffic_filtering=True,id=427d21a8-099b-4a97-8428-39ba7ed4d384,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427d21a8-09') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap427d21a8-09, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e7d313f-a9a5-46b5-a6a6-028bfd3841e2) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:49:55 user nova-compute[75215]: INFO os_vif [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:e5:81,bridge_name='br-int',has_traffic_filtering=True,id=427d21a8-099b-4a97-8428-39ba7ed4d384,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427d21a8-09')
Nov 11 01:49:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmriZxQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:49:55 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 is timed out.
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bf6dc0-9819-4d4a-ae73-972bebf4ce41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Successfully detached device vdb from instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 from the live domain config.
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:49:55 user nova-compute[75215]: No targets found.
Nov 11 01:49:55 user nova-compute[75215]: iSNS:
Nov 11 01:49:55 user nova-compute[75215]: No targets found.
Nov 11 01:49:55 user nova-compute[75215]: STATIC:
Nov 11 01:49:55 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a
Nov 11 01:49:55 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:55 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:55 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2
Nov 11 01:49:55 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:55 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:55 user nova-compute[75215]: FIRMWARE:
Nov 11 01:49:55 user nova-compute[75215]: No targets found.
Nov 11 01:49:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:49:55 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:49:55 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKIUoCjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:49:55 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f401eeb7-226a-4cf7-9183-d1f175f48491]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f48607-7496-48a2-98f9-fc4bd16ee6c6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:55 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a (non-flash)
Nov 11 01:49:55 user nova-compute[75215]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4044309120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a'): ({'sdh'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Removing single pathed devices sdh {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9704a80-392c-4b6f-9844-e0718ebdd4bc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d43aef-29b8-4d70-a502-19a78185d22d]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Flushing IO for device /dev/sdh {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9392c90-8b24-4042-8879-7ca5574de913]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e302354-67f5-4ed8-9ac6-25676e623eae]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] SCSI volumes sdh have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2dd325-fabc-4873-a49a-b0a5df010fb8]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG nova.objects.instance [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cc1b8f1f-9af9-4469-b950-dd8327095457 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.355s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3c10b5-89ae-484e-b833-c82a670d6279]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a, portal: 172.16.0.220,3260]
Nov 11 01:49:55 user nova-compute[75215]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a, portal: 172.16.0.220,3260] successful.
Nov 11 01:49:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5756be5-b549-4aa5-a440-62df68449e6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d5e7ef-44e4-4624-a4a3-3c2badd68c43]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] <== disconnect_volume: return (336ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:49:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Deleting instance files /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327_del
Nov 11 01:49:55 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Deletion of /opt/stack/data/nova/instances/b372f84a-390e-4707-ad3c-8d9f0a7c8327_del complete
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.303s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[110e0f4f-1cc3-40c8-91c0-26309e47761f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:49:55 user nova-compute[75215]: No targets found.
Nov 11 01:49:55 user nova-compute[75215]: iSNS:
Nov 11 01:49:55 user nova-compute[75215]: No targets found.
Nov 11 01:49:55 user nova-compute[75215]: STATIC:
Nov 11 01:49:55 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2
Nov 11 01:49:55 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:49:55 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:49:55 user nova-compute[75215]: FIRMWARE:
Nov 11 01:49:55 user nova-compute[75215]: No targets found.
Nov 11 01:49:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:49:55 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:49:55 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc458d6-a74c-426d-b515-af9088fe688e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: INFO nova.compute.manager [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f51d332-60cf-4b70-9ecd-2ecf8f5271bd]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 (non-flash)
Nov 11 01:49:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4020f24820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3b2ed9-2bab-4e6e-a0da-4026772d3a1f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd94c6e-c927-4055-9a5d-224b14674b7b]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca52ee-e82f-488d-a909-f86751c47baf]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fc78ec-5915-467a-812f-8bac0b80cecb]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[65329afd-0de4-4ff9-a3c9-2f625a4baa4e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5898731-77ef-416b-8c9e-5f494fcd75b9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2, portal: 172.16.0.220,3260]
Nov 11 01:49:55 user nova-compute[75215]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2, portal: 172.16.0.220,3260] successful.
Nov 11 01:49:55 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c8163d-601e-4162-bed7-492694ce5ae2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf3e2f7-67d6-46d9-aa8b-32f4d7b4b5bd]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] <== disconnect_volume: return (645ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:49:55 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:49:56 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Took 0.56 seconds to deallocate network for instance.
Nov 11 01:49:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-16e48520-4158-48d6-8b7e-92122fba7f8b req-acb7e1fa-9497-4656-894a-2320bf73132d service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-deleted-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-f9590dff-1a93-4eda-bddc-e6bc44f7aa56 req-016f7ac6-ea93-4b01-a5c8-7427d93e794d service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f9590dff-1a93-4eda-bddc-e6bc44f7aa56 req-016f7ac6-ea93-4b01-a5c8-7427d93e794d service nova] Acquiring lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f9590dff-1a93-4eda-bddc-e6bc44f7aa56 req-016f7ac6-ea93-4b01-a5c8-7427d93e794d service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f9590dff-1a93-4eda-bddc-e6bc44f7aa56 req-016f7ac6-ea93-4b01-a5c8-7427d93e794d service nova] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-f9590dff-1a93-4eda-bddc-e6bc44f7aa56 req-016f7ac6-ea93-4b01-a5c8-7427d93e794d service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] No waiting events found dispatching network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:49:56 user nova-compute[75215]: WARNING nova.compute.manager [req-f9590dff-1a93-4eda-bddc-e6bc44f7aa56 req-016f7ac6-ea93-4b01-a5c8-7427d93e794d service nova] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Received unexpected event network-vif-plugged-427d21a8-099b-4a97-8428-39ba7ed4d384 for instance with vm_state active and task_state deleting.
Nov 11 01:49:56 user nova-compute[75215]: DEBUG nova.objects.instance [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lazy-loading 'flavor' on Instance uuid 2a264905-f5f0-46a9-9ccb-df09c0d6d534 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:49:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-bb8e1fda-34f6-45f4-9dc6-763a259df816 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.481s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:57 user nova-compute[75215]: INFO nova.compute.manager [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: b372f84a-390e-4707-ad3c-8d9f0a7c8327] Took 1.13 seconds to detach 1 volumes for instance.
Nov 11 01:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:49:57 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:49:57 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:49:57 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Deleted allocations for instance b372f84a-390e-4707-ad3c-8d9f0a7c8327
Nov 11 01:49:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d8c4c2a4-8750-49d7-8cd9-dbb2805ac132 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "b372f84a-390e-4707-ad3c-8d9f0a7c8327" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.635s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:07 user nova-compute[75215]: INFO nova.compute.manager [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Terminating instance
Nov 11 01:50:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-764724c5-b118-4ddd-be3d-03a8d2753430 req-82d641b9-d500-4e46-9834-11998e098e3e service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received event network-vif-unplugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-764724c5-b118-4ddd-be3d-03a8d2753430 req-82d641b9-d500-4e46-9834-11998e098e3e service nova] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-764724c5-b118-4ddd-be3d-03a8d2753430 req-82d641b9-d500-4e46-9834-11998e098e3e service nova] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-764724c5-b118-4ddd-be3d-03a8d2753430 req-82d641b9-d500-4e46-9834-11998e098e3e service nova] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-764724c5-b118-4ddd-be3d-03a8d2753430 req-82d641b9-d500-4e46-9834-11998e098e3e service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] No waiting events found dispatching network-vif-unplugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-764724c5-b118-4ddd-be3d-03a8d2753430 req-82d641b9-d500-4e46-9834-11998e098e3e service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received event network-vif-unplugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Instance destroyed successfully.
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'resources' on Instance uuid cd88426d-bcc9-4004-855f-a8d5b540ef55 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-930732941',display_name='tempest-AttachVolumeNegativeTest-server-930732941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-930732941',id=33,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0B9lplB4AeZqPNeI9AaHUpLLwVPTo3fTa7WDyvfuq3i8EotmpjiRHDEzgY/N1wLFzk7Vkejp8jkjUJ6JzyoDreKJlrowSq2rnNBLvrSSP56bdDl0/bMJ4SMzmqSYya9Q==',key_name='tempest-keypair-44535122',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-ep2jpupb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=cd88426d-bcc9-4004-855f-a8d5b540ef55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "address": "fa:16:3e:80:2a:6e", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e765a41-1f", "ovs_interfaceid": "8e765a41-1fbf-4a36-a5a1-7229317c8538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:2a:6e,bridge_name='br-int',has_traffic_filtering=True,id=8e765a41-1fbf-4a36-a5a1-7229317c8538,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e765a41-1f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG os_vif [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:2a:6e,bridge_name='br-int',has_traffic_filtering=True,id=8e765a41-1fbf-4a36-a5a1-7229317c8538,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e765a41-1f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e765a41-1f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85d182bf-0760-4acf-b2ee-707bd1d50541) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:08 user nova-compute[75215]: INFO os_vif [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:2a:6e,bridge_name='br-int',has_traffic_filtering=True,id=8e765a41-1fbf-4a36-a5a1-7229317c8538,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e765a41-1f')
Nov 11 01:50:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Deleting instance files /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55_del
Nov 11 01:50:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Deletion of /opt/stack/data/nova/instances/cd88426d-bcc9-4004-855f-a8d5b540ef55_del complete
Nov 11 01:50:08 user nova-compute[75215]: INFO nova.compute.manager [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 11 01:50:08 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:50:08 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:50:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:09 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:09 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Took 1.06 seconds to deallocate network for instance.
Nov 11 01:50:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:10 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:50:10 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:50:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-255e245c-27fb-4617-9502-7fa3b7816f6b req-29fc4d2c-d747-4917-826b-64fbfeec0078 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received event network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-255e245c-27fb-4617-9502-7fa3b7816f6b req-29fc4d2c-d747-4917-826b-64fbfeec0078 service nova] Acquiring lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-255e245c-27fb-4617-9502-7fa3b7816f6b req-29fc4d2c-d747-4917-826b-64fbfeec0078 service nova] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-255e245c-27fb-4617-9502-7fa3b7816f6b req-29fc4d2c-d747-4917-826b-64fbfeec0078 service nova] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-255e245c-27fb-4617-9502-7fa3b7816f6b req-29fc4d2c-d747-4917-826b-64fbfeec0078 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] No waiting events found dispatching network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:10 user nova-compute[75215]: WARNING nova.compute.manager [req-255e245c-27fb-4617-9502-7fa3b7816f6b req-29fc4d2c-d747-4917-826b-64fbfeec0078 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received unexpected event network-vif-plugged-8e765a41-1fbf-4a36-a5a1-7229317c8538 for instance with vm_state deleted and task_state None.
Nov 11 01:50:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-255e245c-27fb-4617-9502-7fa3b7816f6b req-29fc4d2c-d747-4917-826b-64fbfeec0078 service nova] [instance: cd88426d-bcc9-4004-855f-a8d5b540ef55] Received event network-vif-deleted-8e765a41-1fbf-4a36-a5a1-7229317c8538 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:10 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Deleted allocations for instance cd88426d-bcc9-4004-855f-a8d5b540ef55
Nov 11 01:50:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-91489d70-9996-4a1e-9cc8-78a2e4f2592b tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "cd88426d-bcc9-4004-855f-a8d5b540ef55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.535s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "34678116-4acb-438f-b14a-16459c723573" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:25 user nova-compute[75215]: INFO nova.compute.manager [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Terminating instance
Nov 11 01:50:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-52a759fc-089d-4096-b176-01149a4b23bb req-455a65db-f64e-4642-a12b-ab2ae3947419 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52a759fc-089d-4096-b176-01149a4b23bb req-455a65db-f64e-4642-a12b-ab2ae3947419 service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52a759fc-089d-4096-b176-01149a4b23bb req-455a65db-f64e-4642-a12b-ab2ae3947419 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-52a759fc-089d-4096-b176-01149a4b23bb req-455a65db-f64e-4642-a12b-ab2ae3947419 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-52a759fc-089d-4096-b176-01149a4b23bb req-455a65db-f64e-4642-a12b-ab2ae3947419 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-52a759fc-089d-4096-b176-01149a4b23bb req-455a65db-f64e-4642-a12b-ab2ae3947419 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-unplugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Instance destroyed successfully.
Nov 11 01:50:25 user nova-compute[75215]: DEBUG nova.objects.instance [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lazy-loading 'resources' on Instance uuid 34678116-4acb-438f-b14a-16459c723573 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T01:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-934126155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-934126155',id=31,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFJcOSgaYf9+mZkYkxCrUGuCwgbtYACCzTwvkkfejrTLhFkXUkm/xvYjqPtTcwDDcbXKKS0+8uzbi3Uavxrcs1Lk2l9AbCd0/2kPIJxp+JtETMO9p/rfjYVv3PHVhxPww==',key_name='tempest-keypair-848868881',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:48:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='739153e36b674c839c8d7bb97201e4aa',ramdisk_id='',reservation_id='r-n9wqxq0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1029212070',owner_user_name='tempest-AttachVolumeShelveTestJSON-1029212070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:48:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c0895e92ca4572b6f004d360f18eaf',uuid=34678116-4acb-438f-b14a-16459c723573,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converting VIF {"id": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "address": "fa:16:3e:d4:9e:9e", "network": {"id": "e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2112612333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739153e36b674c839c8d7bb97201e4aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d90c48-0e", "ovs_interfaceid": "d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG os_vif [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6d90c48-0e, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea664be5-e98a-4db0-8bde-1d64b30a35eb) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:25 user nova-compute[75215]: INFO os_vif [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac,network=Network(e0713b2e-8d8d-4c87-b0a8-dca2e82a5dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d90c48-0e')
Nov 11 01:50:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Deleting instance files /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573_del
Nov 11 01:50:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Deletion of /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573_del complete
Nov 11 01:50:25 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001f, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/34678116-4acb-438f-b14a-16459c723573/disk
Nov 11 01:50:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:50:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=25.13143539428711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:26 user nova-compute[75215]: INFO nova.compute.manager [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] [instance: 34678116-4acb-438f-b14a-16459c723573] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 11 01:50:26 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 34678116-4acb-438f-b14a-16459c723573] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 330defc6-9b43-4f1e-9a76-94b23750e1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 34678116-4acb-438f-b14a-16459c723573 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:50:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:50:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:50:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c32e056-ad9e-4cde-b53d-1a17ac2ab7fc req-78885ee3-a5a4-48b4-82f1-5c1b49ff5f38 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c32e056-ad9e-4cde-b53d-1a17ac2ab7fc req-78885ee3-a5a4-48b4-82f1-5c1b49ff5f38 service nova] Acquiring lock "34678116-4acb-438f-b14a-16459c723573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c32e056-ad9e-4cde-b53d-1a17ac2ab7fc req-78885ee3-a5a4-48b4-82f1-5c1b49ff5f38 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c32e056-ad9e-4cde-b53d-1a17ac2ab7fc req-78885ee3-a5a4-48b4-82f1-5c1b49ff5f38 service nova] Lock "34678116-4acb-438f-b14a-16459c723573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c32e056-ad9e-4cde-b53d-1a17ac2ab7fc req-78885ee3-a5a4-48b4-82f1-5c1b49ff5f38 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] No waiting events found dispatching network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:27 user nova-compute[75215]: WARNING nova.compute.manager [req-0c32e056-ad9e-4cde-b53d-1a17ac2ab7fc req-78885ee3-a5a4-48b4-82f1-5c1b49ff5f38 service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received unexpected event network-vif-plugged-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac for instance with vm_state active and task_state deleting.
Nov 11 01:50:28 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:28 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 34678116-4acb-438f-b14a-16459c723573] Took 1.73 seconds to deallocate network for instance.
Nov 11 01:50:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:50:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:50:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:28 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Deleted allocations for instance 34678116-4acb-438f-b14a-16459c723573
Nov 11 01:50:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-461596cc-a7ab-4df1-93b1-f45a862b92b9 tempest-AttachVolumeShelveTestJSON-1029212070 tempest-AttachVolumeShelveTestJSON-1029212070-project-member] Lock "34678116-4acb-438f-b14a-16459c723573" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.624s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-29f7ec77-ed22-4972-9785-69ccd69c07b5 req-33eb84ba-00d5-4e5f-a0e4-682754b2945d service nova] [instance: 34678116-4acb-438f-b14a-16459c723573] Received event network-vif-deleted-d6d90c48-0ee3-4fd6-9168-cfc2f979d8ac {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:30 user nova-compute[75215]: INFO nova.compute.manager [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attaching volume 0fb2d57e-2dbd-4498-839a-a61939d7b0e5 to /dev/vdb
Nov 11 01:50:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG os_brick.utils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f471e7-1902-4a26-903f-ea1fa6efe673]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f876c-6359-4933-a9f5-d725ba93d05e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d625ea1-4799-44aa-b076-2be36805eff4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3303646-30ac-466f-8a4c-1c6639d21556]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:50:31 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:50:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b0d61-0d01-4c37-9b0f-3158bd22631b]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG os_brick.utils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating existing volume attachment record: e30b957f-b19d-445b-9e15-c28817ba65b2 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:50:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:50:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:50:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:50:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 01:50:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 01:50:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:37 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:50:37 user nova-compute[75215]: INFO nova.compute.claims [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Claim successful on node user
Nov 11 01:50:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:50:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:50:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:50:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:50:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG nova.policy [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2b088eb7c0b47b2bc676cbc3f8a1b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd80ef3ccb4c4e978990e15a2b0dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:50:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Creating image(s)
Nov 11 01:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "/opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "/opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "/opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "21fe5f9694d7ad27375f2dea7cbac7907a7a38cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "21fe5f9694d7ad27375f2dea7cbac7907a7a38cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Successfully created port: a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:50:39 user nova-compute[75215]: INFO nova.compute.manager [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Terminating instance
Nov 11 01:50:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf.part --force-share --output=json" returned: 0 in 0.237s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG nova.virt.images [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] 28182716-dd48-41ea-8267-0edd8e8cff59 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf.part /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf.part /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf.converted" returned: 0 in 0.266s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "21fe5f9694d7ad27375f2dea7cbac7907a7a38cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.348s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf --force-share --output=json" returned: 0 in 0.271s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "21fe5f9694d7ad27375f2dea7cbac7907a7a38cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "21fe5f9694d7ad27375f2dea7cbac7907a7a38cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Instance destroyed successfully.
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.objects.instance [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lazy-loading 'resources' on Instance uuid 2a264905-f5f0-46a9-9ccb-df09c0d6d534 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-864506544',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-864506544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8645065',id=32,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNVODd+2Ry6mP2eD2dCd1T0UInTmkeB1e2/ghdujsK0x4uUoAchnA8s1Z4eqeuJiF3lX4tlL/1MrU5eAfveDSE8+TZh+qnJWWofA9Mgt/fk75MlKEA3eoi11RVJoa0ZA==',key_name='tempest-keypair-186861194',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ef1728a5ab4ddca7ec7000b3cff602',ramdisk_id='',reservation_id='r-t5gmsjlw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1160474950',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a895d5d9bef42c2987ea6b1e60e2313',uuid=2a264905-f5f0-46a9-9ccb-df09c0d6d534,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Converting VIF {"id": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "address": "fa:16:3e:76:fe:45", "network": {"id": "bb778ba7-bd87-4921-a19f-f70551c753b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-336647976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ef1728a5ab4ddca7ec7000b3cff602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620e811-15", "ovs_interfaceid": "2620e811-15ec-4d58-8c28-fdf9e3d871f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=2620e811-15ec-4d58-8c28-fdf9e3d871f8,network=Network(bb778ba7-bd87-4921-a19f-f70551c753b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620e811-15') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG os_vif [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=2620e811-15ec-4d58-8c28-fdf9e3d871f8,network=Network(bb778ba7-bd87-4921-a19f-f70551c753b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620e811-15') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2620e811-15, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ac8c69d-7088-4d41-b171-d76574967279) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:40 user nova-compute[75215]: INFO os_vif [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=2620e811-15ec-4d58-8c28-fdf9e3d871f8,network=Network(bb778ba7-bd87-4921-a19f-f70551c753b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620e811-15')
Nov 11 01:50:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Deleting instance files /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534_del
Nov 11 01:50:40 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Deletion of /opt/stack/data/nova/instances/2a264905-f5f0-46a9-9ccb-df09c0d6d534_del complete
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf --force-share --output=json" returned: 0 in 0.263s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf,backing_fmt=raw /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:40 user nova-compute[75215]: INFO nova.compute.manager [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf,backing_fmt=raw /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk 1073741824" returned: 0 in 0.061s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "21fe5f9694d7ad27375f2dea7cbac7907a7a38cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Successfully updated port: a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-cae4c3df-4fdb-47fe-bd2e-3f765092ab48 req-095d69e7-0173-40ec-bfa6-1ed8936f14eb service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-cae4c3df-4fdb-47fe-bd2e-3f765092ab48 req-095d69e7-0173-40ec-bfa6-1ed8936f14eb service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing instance network info cache due to event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cae4c3df-4fdb-47fe-bd2e-3f765092ab48 req-095d69e7-0173-40ec-bfa6-1ed8936f14eb service nova] Acquiring lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cae4c3df-4fdb-47fe-bd2e-3f765092ab48 req-095d69e7-0173-40ec-bfa6-1ed8936f14eb service nova] Acquired lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-cae4c3df-4fdb-47fe-bd2e-3f765092ab48 req-095d69e7-0173-40ec-bfa6-1ed8936f14eb service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-cae4c3df-4fdb-47fe-bd2e-3f765092ab48 req-095d69e7-0173-40ec-bfa6-1ed8936f14eb service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Cannot resize image /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Ensure instance console log exists: /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-cae4c3df-4fdb-47fe-bd2e-3f765092ab48 req-095d69e7-0173-40ec-bfa6-1ed8936f14eb service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cae4c3df-4fdb-47fe-bd2e-3f765092ab48 req-095d69e7-0173-40ec-bfa6-1ed8936f14eb service nova] Releasing lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquired lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:50:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating instance_info_cache with network_info: [{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Releasing lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance network_info: |[{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Start _get_guest_xml network_info=[{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:50:33Z,direct_url=<?>,disk_format='qcow2',id=28182716-dd48-41ea-8267-0edd8e8cff59,min_disk=0,min_ram=0,name='tempest-scenario-img--2034652913',owner='a7bd80ef3ccb4c4e978990e15a2b0dd3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:50:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '28182716-dd48-41ea-8267-0edd8e8cff59'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:50:41 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:50:41 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:50:33Z,direct_url=<?>,disk_format='qcow2',id=28182716-dd48-41ea-8267-0edd8e8cff59,min_disk=0,min_ram=0,name='tempest-scenario-img--2034652913',owner='a7bd80ef3ccb4c4e978990e15a2b0dd3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:50:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1760529250',display_name='tempest-TestMinimumBasicScenario-server-1760529250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1760529250',id=35,image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMTJHla9hRHoawtbC1SkXIq8VVp2tsZeyfGz9fC9EJ34MdVWCZPTOBokWXOnzLWRmZpRJRcL+MXI4/4Hm+AQ19ex8lqXxCo/cyxyFYdIqsbwX0500h77p/fGNIRSaPYRw==',key_name='tempest-TestMinimumBasicScenario-1379367510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-8555jnjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:50:38Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=a48d0e4a-e786-43b9-aee9-20ba981b83fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'pci_devices' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:50:41 user nova-compute[75215]:   <uuid>a48d0e4a-e786-43b9-aee9-20ba981b83fe</uuid>
Nov 11 01:50:41 user nova-compute[75215]:   <name>instance-00000023</name>
Nov 11 01:50:41 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:50:41 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:50:41 user nova-compute[75215]:   <metadata>
Nov 11 01:50:41 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:50:41 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:50:41 user nova-compute[75215]:       <nova:name>tempest-TestMinimumBasicScenario-server-1760529250</nova:name>
Nov 11 01:50:41 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:50:41</nova:creationTime>
Nov 11 01:50:41 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:50:41 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:50:41 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:50:41 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:50:41 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:50:41 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:50:41 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:50:41 user nova-compute[75215]:       <nova:owner>
Nov 11 01:50:41 user nova-compute[75215]:         <nova:user uuid="b2b088eb7c0b47b2bc676cbc3f8a1b4c">tempest-TestMinimumBasicScenario-1149206322-project-member</nova:user>
Nov 11 01:50:41 user nova-compute[75215]:         <nova:project uuid="a7bd80ef3ccb4c4e978990e15a2b0dd3">tempest-TestMinimumBasicScenario-1149206322</nova:project>
Nov 11 01:50:41 user nova-compute[75215]:       </nova:owner>
Nov 11 01:50:41 user nova-compute[75215]:       <nova:root type="image" uuid="28182716-dd48-41ea-8267-0edd8e8cff59"/>
Nov 11 01:50:41 user nova-compute[75215]:       <nova:ports>
Nov 11 01:50:41 user nova-compute[75215]:         <nova:port uuid="a26cf620-d53e-48e5-93ba-5ad8393f82fb">
Nov 11 01:50:41 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 01:50:41 user nova-compute[75215]:         </nova:port>
Nov 11 01:50:41 user nova-compute[75215]:       </nova:ports>
Nov 11 01:50:41 user nova-compute[75215]:     </nova:instance>
Nov 11 01:50:41 user nova-compute[75215]:   </metadata>
Nov 11 01:50:41 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:50:41 user nova-compute[75215]:     <system>
Nov 11 01:50:41 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:50:41 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:50:41 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:50:41 user nova-compute[75215]:       <entry name="serial">a48d0e4a-e786-43b9-aee9-20ba981b83fe</entry>
Nov 11 01:50:41 user nova-compute[75215]:       <entry name="uuid">a48d0e4a-e786-43b9-aee9-20ba981b83fe</entry>
Nov 11 01:50:41 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:50:41 user nova-compute[75215]:     </system>
Nov 11 01:50:41 user nova-compute[75215]:   </sysinfo>
Nov 11 01:50:41 user nova-compute[75215]:   <os>
Nov 11 01:50:41 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:50:41 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:50:41 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:50:41 user nova-compute[75215]:   </os>
Nov 11 01:50:41 user nova-compute[75215]:   <features>
Nov 11 01:50:41 user nova-compute[75215]:     <acpi/>
Nov 11 01:50:41 user nova-compute[75215]:     <apic/>
Nov 11 01:50:41 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:50:41 user nova-compute[75215]:   </features>
Nov 11 01:50:41 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:50:41 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:50:41 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:50:41 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:50:41 user nova-compute[75215]:   </clock>
Nov 11 01:50:41 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:50:41 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:50:41 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:50:41 user nova-compute[75215]:   </cpu>
Nov 11 01:50:41 user nova-compute[75215]:   <devices>
Nov 11 01:50:41 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:50:41 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:50:41 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk"/>
Nov 11 01:50:41 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:50:41 user nova-compute[75215]:     </disk>
Nov 11 01:50:41 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:50:41 user nova-compute[75215]:       <mac address="fa:16:3e:25:2f:f5"/>
Nov 11 01:50:41 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:50:41 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:50:41 user nova-compute[75215]:       <target dev="tapa26cf620-d5"/>
Nov 11 01:50:41 user nova-compute[75215]:     </interface>
Nov 11 01:50:41 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:50:41 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/console.log" append="off"/>
Nov 11 01:50:41 user nova-compute[75215]:     </serial>
Nov 11 01:50:41 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:50:41 user nova-compute[75215]:     <video>
Nov 11 01:50:41 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:50:41 user nova-compute[75215]:     </video>
Nov 11 01:50:41 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:50:41 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:50:41 user nova-compute[75215]:     </rng>
Nov 11 01:50:41 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:50:41 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:50:41 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:50:41 user nova-compute[75215]:     </memballoon>
Nov 11 01:50:41 user nova-compute[75215]:   </devices>
Nov 11 01:50:41 user nova-compute[75215]: </domain>
Nov 11 01:50:41 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1760529250',display_name='tempest-TestMinimumBasicScenario-server-1760529250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1760529250',id=35,image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMTJHla9hRHoawtbC1SkXIq8VVp2tsZeyfGz9fC9EJ34MdVWCZPTOBokWXOnzLWRmZpRJRcL+MXI4/4Hm+AQ19ex8lqXxCo/cyxyFYdIqsbwX0500h77p/fGNIRSaPYRw==',key_name='tempest-TestMinimumBasicScenario-1379367510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-8555jnjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:50:38Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=a48d0e4a-e786-43b9-aee9-20ba981b83fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG os_vif [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e52fd6a2-f515-5f15-ac87-ca26d3818f36', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa26cf620-d5, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa26cf620-d5, col_values=(('qos', UUID('c84339e8-287e-4ee7-a552-de0dcca5290e')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa26cf620-d5, col_values=(('external_ids', {'iface-id': 'a26cf620-d53e-48e5-93ba-5ad8393f82fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:2f:f5', 'vm-uuid': 'a48d0e4a-e786-43b9-aee9-20ba981b83fe'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:41 user nova-compute[75215]: INFO os_vif [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5')
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-29b25595-4446-43cb-9a79-1f7e08be182c req-3c8336d6-af54-4b69-9aa6-57372d5d12b3 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Received event network-vif-deleted-2620e811-15ec-4d58-8c28-fdf9e3d871f8 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:41 user nova-compute[75215]: INFO nova.compute.manager [req-29b25595-4446-43cb-9a79-1f7e08be182c req-3c8336d6-af54-4b69-9aa6-57372d5d12b3 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Neutron deleted interface 2620e811-15ec-4d58-8c28-fdf9e3d871f8; detaching it from the instance and deleting it from the info cache
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-29b25595-4446-43cb-9a79-1f7e08be182c req-3c8336d6-af54-4b69-9aa6-57372d5d12b3 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:41 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Took 1.09 seconds to deallocate network for instance.
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-29b25595-4446-43cb-9a79-1f7e08be182c req-3c8336d6-af54-4b69-9aa6-57372d5d12b3 service nova] [instance: 2a264905-f5f0-46a9-9ccb-df09c0d6d534] Detach interface failed, port_id=2620e811-15ec-4d58-8c28-fdf9e3d871f8, reason: Instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No VIF found with MAC fa:16:3e:25:2f:f5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.143s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:41 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:50:41 user nova-compute[75215]: INFO nova.compute.claims [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Claim successful on node user
Nov 11 01:50:41 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Deleted allocations for instance 2a264905-f5f0-46a9-9ccb-df09c0d6d534
Nov 11 01:50:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-5a6493fa-4329-4240-98a0-ed14645bb361 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950 tempest-TestServerVolumeAttachScenarioOldVersion-1160474950-project-member] Lock "2a264905-f5f0-46a9-9ccb-df09c0d6d534" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.798s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:50:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.policy [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12f927e992bd4ec1b0f4c8b0cd89bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d1ef6255a5493899c6d99db0c98b1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:50:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Creating image(s)
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "/opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "/opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "/opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.252s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk 1073741824" returned: 0 in 0.068s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Successfully created port: 8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.264s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-01772026-b9e5-4e04-a818-59942f649450 req-24b1d7a3-8b17-49c2-a465-a00e86074d61 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-01772026-b9e5-4e04-a818-59942f649450 req-24b1d7a3-8b17-49c2-a465-a00e86074d61 service nova] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-01772026-b9e5-4e04-a818-59942f649450 req-24b1d7a3-8b17-49c2-a465-a00e86074d61 service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-01772026-b9e5-4e04-a818-59942f649450 req-24b1d7a3-8b17-49c2-a465-a00e86074d61 service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-01772026-b9e5-4e04-a818-59942f649450 req-24b1d7a3-8b17-49c2-a465-a00e86074d61 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] No waiting events found dispatching network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:43 user nova-compute[75215]: WARNING nova.compute.manager [req-01772026-b9e5-4e04-a818-59942f649450 req-24b1d7a3-8b17-49c2-a465-a00e86074d61 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received unexpected event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb for instance with vm_state building and task_state spawning.
Nov 11 01:50:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Cannot resize image /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Ensure instance console log exists: /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Successfully updated port: 8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquired lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updating instance_info_cache with network_info: [{"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Releasing lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Instance network_info: |[{"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Start _get_guest_xml network_info=[{"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:50:44 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:50:44 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-156493280',display_name='tempest-TestServerVolumeAttachmentScenario-server-156493280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-156493280',id=36,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3rKqtL4+3Qfd+IWwAfTn40XIJLkX5AM8InfVlc050T4/tcDjYcfiv5+NNY19IKvbnRRx3ELC6lwPjSltPymY0iqX7E1ujAKPuO3E81Ya2xO6/JONuCH0SYVxekg6Ag==',key_name='tempest-keypair-510937134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63d1ef6255a5493899c6d99db0c98b1a',ramdisk_id='',reservation_id='r-yqo5ahc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-59812108',owner_user_name='tempest-TestServerVolumeAttachmentScenario-59812108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12f927e992bd4ec1b0f4c8b0cd89bd8b',uuid=19c9f240-3967-4387-bac5-0e6fb79e13af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Converting VIF {"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:f5,bridge_name='br-int',has_traffic_filtering=True,id=8470338f-e32a-4529-9cd7-c31a997b29de,network=Network(15731828-095a-4b14-b4a6-53aeb36d1784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8470338f-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lazy-loading 'pci_devices' on Instance uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:50:44 user nova-compute[75215]:   <uuid>19c9f240-3967-4387-bac5-0e6fb79e13af</uuid>
Nov 11 01:50:44 user nova-compute[75215]:   <name>instance-00000024</name>
Nov 11 01:50:44 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:50:44 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:50:44 user nova-compute[75215]:   <metadata>
Nov 11 01:50:44 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:50:44 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:50:44 user nova-compute[75215]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-156493280</nova:name>
Nov 11 01:50:44 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:50:44</nova:creationTime>
Nov 11 01:50:44 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:50:44 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:50:44 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:50:44 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:50:44 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:50:44 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:50:44 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:50:44 user nova-compute[75215]:       <nova:owner>
Nov 11 01:50:44 user nova-compute[75215]:         <nova:user uuid="12f927e992bd4ec1b0f4c8b0cd89bd8b">tempest-TestServerVolumeAttachmentScenario-59812108-project-member</nova:user>
Nov 11 01:50:44 user nova-compute[75215]:         <nova:project uuid="63d1ef6255a5493899c6d99db0c98b1a">tempest-TestServerVolumeAttachmentScenario-59812108</nova:project>
Nov 11 01:50:44 user nova-compute[75215]:       </nova:owner>
Nov 11 01:50:44 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:50:44 user nova-compute[75215]:       <nova:ports>
Nov 11 01:50:44 user nova-compute[75215]:         <nova:port uuid="8470338f-e32a-4529-9cd7-c31a997b29de">
Nov 11 01:50:44 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:50:44 user nova-compute[75215]:         </nova:port>
Nov 11 01:50:44 user nova-compute[75215]:       </nova:ports>
Nov 11 01:50:44 user nova-compute[75215]:     </nova:instance>
Nov 11 01:50:44 user nova-compute[75215]:   </metadata>
Nov 11 01:50:44 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:50:44 user nova-compute[75215]:     <system>
Nov 11 01:50:44 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:50:44 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:50:44 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:50:44 user nova-compute[75215]:       <entry name="serial">19c9f240-3967-4387-bac5-0e6fb79e13af</entry>
Nov 11 01:50:44 user nova-compute[75215]:       <entry name="uuid">19c9f240-3967-4387-bac5-0e6fb79e13af</entry>
Nov 11 01:50:44 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:50:44 user nova-compute[75215]:     </system>
Nov 11 01:50:44 user nova-compute[75215]:   </sysinfo>
Nov 11 01:50:44 user nova-compute[75215]:   <os>
Nov 11 01:50:44 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:50:44 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:50:44 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:50:44 user nova-compute[75215]:   </os>
Nov 11 01:50:44 user nova-compute[75215]:   <features>
Nov 11 01:50:44 user nova-compute[75215]:     <acpi/>
Nov 11 01:50:44 user nova-compute[75215]:     <apic/>
Nov 11 01:50:44 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:50:44 user nova-compute[75215]:   </features>
Nov 11 01:50:44 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:50:44 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:50:44 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:50:44 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:50:44 user nova-compute[75215]:   </clock>
Nov 11 01:50:44 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:50:44 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:50:44 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:50:44 user nova-compute[75215]:   </cpu>
Nov 11 01:50:44 user nova-compute[75215]:   <devices>
Nov 11 01:50:44 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:50:44 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:50:44 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk"/>
Nov 11 01:50:44 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:50:44 user nova-compute[75215]:     </disk>
Nov 11 01:50:44 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:50:44 user nova-compute[75215]:       <mac address="fa:16:3e:79:fc:f5"/>
Nov 11 01:50:44 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:50:44 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:50:44 user nova-compute[75215]:       <target dev="tap8470338f-e3"/>
Nov 11 01:50:44 user nova-compute[75215]:     </interface>
Nov 11 01:50:44 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:50:44 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/console.log" append="off"/>
Nov 11 01:50:44 user nova-compute[75215]:     </serial>
Nov 11 01:50:44 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:50:44 user nova-compute[75215]:     <video>
Nov 11 01:50:44 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:50:44 user nova-compute[75215]:     </video>
Nov 11 01:50:44 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:50:44 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:50:44 user nova-compute[75215]:     </rng>
Nov 11 01:50:44 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:50:44 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:50:44 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:50:44 user nova-compute[75215]:     </memballoon>
Nov 11 01:50:44 user nova-compute[75215]:   </devices>
Nov 11 01:50:44 user nova-compute[75215]: </domain>
Nov 11 01:50:44 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-156493280',display_name='tempest-TestServerVolumeAttachmentScenario-server-156493280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-156493280',id=36,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3rKqtL4+3Qfd+IWwAfTn40XIJLkX5AM8InfVlc050T4/tcDjYcfiv5+NNY19IKvbnRRx3ELC6lwPjSltPymY0iqX7E1ujAKPuO3E81Ya2xO6/JONuCH0SYVxekg6Ag==',key_name='tempest-keypair-510937134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63d1ef6255a5493899c6d99db0c98b1a',ramdisk_id='',reservation_id='r-yqo5ahc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-59812108',owner_user_name='tempest-TestServerVolumeAttachmentScenario-59812108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12f927e992bd4ec1b0f4c8b0cd89bd8b',uuid=19c9f240-3967-4387-bac5-0e6fb79e13af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Converting VIF {"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:f5,bridge_name='br-int',has_traffic_filtering=True,id=8470338f-e32a-4529-9cd7-c31a997b29de,network=Network(15731828-095a-4b14-b4a6-53aeb36d1784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8470338f-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG os_vif [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:f5,bridge_name='br-int',has_traffic_filtering=True,id=8470338f-e32a-4529-9cd7-c31a997b29de,network=Network(15731828-095a-4b14-b4a6-53aeb36d1784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8470338f-e3') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb124367-d793-5223-9954-46b4533afcbe', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8470338f-e3, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8470338f-e3, col_values=(('qos', UUID('1e921558-13c2-4400-a930-11a15c0ea1df')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8470338f-e3, col_values=(('external_ids', {'iface-id': '8470338f-e32a-4529-9cd7-c31a997b29de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:fc:f5', 'vm-uuid': '19c9f240-3967-4387-bac5-0e6fb79e13af'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:44 user nova-compute[75215]: INFO os_vif [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:f5,bridge_name='br-int',has_traffic_filtering=True,id=8470338f-e32a-4529-9cd7-c31a997b29de,network=Network(15731828-095a-4b14-b4a6-53aeb36d1784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8470338f-e3')
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:50:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No VIF found with MAC fa:16:3e:79:fc:f5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:45 user nova-compute[75215]: INFO nova.compute.manager [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Terminating instance
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:50:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance spawned successfully.
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] No waiting events found dispatching network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:45 user nova-compute[75215]: WARNING nova.compute.manager [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received unexpected event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb for instance with vm_state building and task_state spawning.
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received event network-changed-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Refreshing instance network info cache due to event network-changed-8470338f-e32a-4529-9cd7-c31a997b29de. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] Acquiring lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] Acquired lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Refreshing network info cache for port 8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:50:45 user nova-compute[75215]: INFO nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Took 7.25 seconds to spawn the instance on the hypervisor.
Nov 11 01:50:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:50:45 user nova-compute[75215]: INFO nova.compute.manager [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Took 8.64 seconds to build instance.
Nov 11 01:50:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ced45b9e-ddc3-4f7a-90f9-fb20ac3397af tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.788s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-29c4609d-9aae-46c2-926b-74b4c6f013cc req-ca241305-5d29-4d02-8c59-98956b631a22 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received event network-vif-unplugged-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29c4609d-9aae-46c2-926b-74b4c6f013cc req-ca241305-5d29-4d02-8c59-98956b631a22 service nova] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29c4609d-9aae-46c2-926b-74b4c6f013cc req-ca241305-5d29-4d02-8c59-98956b631a22 service nova] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-29c4609d-9aae-46c2-926b-74b4c6f013cc req-ca241305-5d29-4d02-8c59-98956b631a22 service nova] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-29c4609d-9aae-46c2-926b-74b4c6f013cc req-ca241305-5d29-4d02-8c59-98956b631a22 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] No waiting events found dispatching network-vif-unplugged-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-29c4609d-9aae-46c2-926b-74b4c6f013cc req-ca241305-5d29-4d02-8c59-98956b631a22 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received event network-vif-unplugged-eeda3b00-3677-4dd4-bad3-9a7439540308 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updated VIF entry in instance network info cache for port 8470338f-e32a-4529-9cd7-c31a997b29de. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updating instance_info_cache with network_info: [{"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8722da96-8ce3-47f6-ba77-3611032f6b22 req-e0b88156-a97f-468c-b098-dd5e4d3e6e4e service nova] Releasing lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Instance destroyed successfully.
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.objects.instance [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lazy-loading 'resources' on Instance uuid 330defc6-9b43-4f1e-9a76-94b23750e1b0 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-129843831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-129843831',id=1,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32564a70b861419eaefcb97cd327088d',ramdisk_id='',reservation_id='r-9q8yhegy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:31:22Z,user_data=None,user_id='561ad55121d44be1ab7971a495b9347f',uuid=330defc6-9b43-4f1e-9a76-94b23750e1b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converting VIF {"id": "eeda3b00-3677-4dd4-bad3-9a7439540308", "address": "fa:16:3e:44:4c:95", "network": {"id": "6db1222b-14b0-4f0c-a230-f48ebaf0665d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1155315666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32564a70b861419eaefcb97cd327088d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeda3b00-36", "ovs_interfaceid": "eeda3b00-3677-4dd4-bad3-9a7439540308", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:4c:95,bridge_name='br-int',has_traffic_filtering=True,id=eeda3b00-3677-4dd4-bad3-9a7439540308,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeda3b00-36') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG os_vif [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:4c:95,bridge_name='br-int',has_traffic_filtering=True,id=eeda3b00-3677-4dd4-bad3-9a7439540308,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeda3b00-36') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeda3b00-36, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=760e5e49-7355-46ca-b3c3-96900bd65aa6) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:46 user nova-compute[75215]: INFO os_vif [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:4c:95,bridge_name='br-int',has_traffic_filtering=True,id=eeda3b00-3677-4dd4-bad3-9a7439540308,network=Network(6db1222b-14b0-4f0c-a230-f48ebaf0665d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeda3b00-36')
Nov 11 01:50:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Deleting instance files /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0_del
Nov 11 01:50:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Deletion of /opt/stack/data/nova/instances/330defc6-9b43-4f1e-9a76-94b23750e1b0_del complete
Nov 11 01:50:46 user nova-compute[75215]: INFO nova.compute.manager [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Took 1.57 seconds to destroy the instance on the hypervisor.
Nov 11 01:50:46 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:50:47 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Took 0.60 seconds to deallocate network for instance.
Nov 11 01:50:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-e0c6326f-5bea-4597-8503-2ec818204b25 req-0e8700d0-0b2c-4217-b36a-9b3e50db5778 service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received event network-vif-deleted-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:47 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Deleted allocations for instance 330defc6-9b43-4f1e-9a76-94b23750e1b0
Nov 11 01:50:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-83e4bc63-d306-40cd-9a80-8839541be768 tempest-ServerBootFromVolumeStableRescueTest-1327607516 tempest-ServerBootFromVolumeStableRescueTest-1327607516-project-member] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.854s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received event network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Acquiring lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Lock "330defc6-9b43-4f1e-9a76-94b23750e1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] No waiting events found dispatching network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:48 user nova-compute[75215]: WARNING nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 330defc6-9b43-4f1e-9a76-94b23750e1b0] Received unexpected event network-vif-plugged-eeda3b00-3677-4dd4-bad3-9a7439540308 for instance with vm_state deleted and task_state None.
Nov 11 01:50:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received event network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] No waiting events found dispatching network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:48 user nova-compute[75215]: WARNING nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received unexpected event network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de for instance with vm_state building and task_state spawning.
Nov 11 01:50:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received event network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] No waiting events found dispatching network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:50:48 user nova-compute[75215]: WARNING nova.compute.manager [req-8b5667db-295a-426f-902d-680f31ffb819 req-6a0d8b39-248d-4757-8aa4-eb354c0001fb service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received unexpected event network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de for instance with vm_state building and task_state spawning.
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:50:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Instance spawned successfully.
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:50:49 user nova-compute[75215]: INFO nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Took 7.17 seconds to spawn the instance on the hypervisor.
Nov 11 01:50:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:50:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:49 user nova-compute[75215]: INFO nova.compute.manager [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Took 8.19 seconds to build instance.
Nov 11 01:50:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3d0501d7-7e74-48c6-8400-da41eba1e04e tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.344s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImkKfGFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:50:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:50:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:50:57 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[859649ca-f42e-4a7d-85f6-81e789f77ffd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:50:57 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e9a15f-051d-41d2-98c0-d4488ac34862]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5] added
Nov 11 01:50:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8857cfe0-6142-49f3-b185-438a3cc639b2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ed891-cb84-40f3-b788-6ba77a220341]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ImkKfGFx {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ImkKfGFx" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d76979-4ad2-4ac7-9b9f-30814b168c76]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ImkKfGFx'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ed98e-ec97-4aa1-b04d-530c9d28017b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a743f1a-abf4-4dbd-b784-a64f7d39f136]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 01:50:57 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 01:50:57 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:50:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 01:50:57 user nova-compute[75215]: 
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b089ddce-1343-4c41-9938-56564065cabb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5, portal: 172.16.0.220,3260]
Nov 11 01:50:57 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5, portal: 172.16.0.220,3260] successful.
Nov 11 01:50:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59037b6-fa7b-485b-8799-1262e6be9e99]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[82119160-094d-4882-a70d-3060919fe5b6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 (non-flash)
Nov 11 01:50:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 (non-flash)
Nov 11 01:50:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c8d6f-d138-4619-81ce-2a48ec281149]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:50:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImkKfGFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:50:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23566663166366536', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:50:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566663166366536', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:50:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:50:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:50:58 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:50:58 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:50:58 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:50:58 user nova-compute[75215]:   <serial>0fb2d57e-2dbd-4498-839a-a61939d7b0e5</serial>
Nov 11 01:50:58 user nova-compute[75215]: </disk>
Nov 11 01:50:58 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:50:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:50:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:50:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No VIF found with MAC fa:16:3e:fc:42:0d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:50:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-825fd333-fd3d-49eb-bcf8-5a122311723e tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.570s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:50:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:51:01 user nova-compute[75215]: INFO nova.compute.claims [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Claim successful on node user
Nov 11 01:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:01 user nova-compute[75215]: INFO nova.compute.manager [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Detaching volume 0fb2d57e-2dbd-4498-839a-a61939d7b0e5
Nov 11 01:51:01 user nova-compute[75215]: INFO nova.virt.block_device [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attempting to driver detach volume 0fb2d57e-2dbd-4498-839a-a61939d7b0e5 from mountpoint /dev/vdb
Nov 11 01:51:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Attempting to detach device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:51:01 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:51:01 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:51:01 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:51:01 user nova-compute[75215]:   <serial>0fb2d57e-2dbd-4498-839a-a61939d7b0e5</serial>
Nov 11 01:51:01 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:51:01 user nova-compute[75215]: </disk>
Nov 11 01:51:01 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:51:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully detached device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the persistent domain config.
Nov 11 01:51:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:51:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:51:01 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:51:01 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:51:01 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:51:01 user nova-compute[75215]:   <serial>0fb2d57e-2dbd-4498-839a-a61939d7b0e5</serial>
Nov 11 01:51:01 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:51:01 user nova-compute[75215]: </disk>
Nov 11 01:51:01 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:51:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.policy [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da821cfc028b48f6864c064b2ea97c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792836033673405bb7375a08ddc89e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:51:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Creating image(s)
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "/opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "/opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk 1073741824" returned: 0 in 0.057s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Successfully created port: 8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Cannot resize image /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Ensure instance console log exists: /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Successfully updated port: 8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquired lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-48331f27-1443-4de1-a50c-614788612464 req-7f1d8f72-0db7-4b74-8a1e-b2e0e0ad4fd6 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received event network-changed-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-48331f27-1443-4de1-a50c-614788612464 req-7f1d8f72-0db7-4b74-8a1e-b2e0e0ad4fd6 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Refreshing instance network info cache due to event network-changed-8b338adf-c152-428d-8a6c-67d64c549ae2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-48331f27-1443-4de1-a50c-614788612464 req-7f1d8f72-0db7-4b74-8a1e-b2e0e0ad4fd6 service nova] Acquiring lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Updating instance_info_cache with network_info: [{"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Releasing lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Instance network_info: |[{"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-48331f27-1443-4de1-a50c-614788612464 req-7f1d8f72-0db7-4b74-8a1e-b2e0e0ad4fd6 service nova] Acquired lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.network.neutron [req-48331f27-1443-4de1-a50c-614788612464 req-7f1d8f72-0db7-4b74-8a1e-b2e0e0ad4fd6 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Refreshing network info cache for port 8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:51:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Start _get_guest_xml network_info=[{"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:51:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:51:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1595293667',display_name='tempest-AttachVolumeNegativeTest-server-1595293667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1595293667',id=37,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdAL6MFmyBLVZf89/7YhI0jOz/e0ovV+HZcl2fih64ibi3XoDHyBAiai+wSf3VdILdzjPRjumq92Y91NZ3wEc7/V7ab6cetPyMJSHx2iqQ4LHNH5hs16MNBAweuIAoqeg==',key_name='tempest-keypair-851723402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-388r3t6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=0f4e34d2-8602-495d-8b06-e21748b7add1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c1:9b,bridge_name='br-int',has_traffic_filtering=True,id=8b338adf-c152-428d-8a6c-67d64c549ae2,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b338adf-c1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f4e34d2-8602-495d-8b06-e21748b7add1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:51:04 user nova-compute[75215]:   <uuid>0f4e34d2-8602-495d-8b06-e21748b7add1</uuid>
Nov 11 01:51:04 user nova-compute[75215]:   <name>instance-00000025</name>
Nov 11 01:51:04 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:51:04 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:51:04 user nova-compute[75215]:   <metadata>
Nov 11 01:51:04 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:51:04 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:51:04 user nova-compute[75215]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1595293667</nova:name>
Nov 11 01:51:04 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:51:04</nova:creationTime>
Nov 11 01:51:04 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:51:04 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:51:04 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:51:04 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:51:04 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:51:04 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:51:04 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:51:04 user nova-compute[75215]:       <nova:owner>
Nov 11 01:51:04 user nova-compute[75215]:         <nova:user uuid="da821cfc028b48f6864c064b2ea97c02">tempest-AttachVolumeNegativeTest-791087113-project-member</nova:user>
Nov 11 01:51:04 user nova-compute[75215]:         <nova:project uuid="792836033673405bb7375a08ddc89e18">tempest-AttachVolumeNegativeTest-791087113</nova:project>
Nov 11 01:51:04 user nova-compute[75215]:       </nova:owner>
Nov 11 01:51:04 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:51:04 user nova-compute[75215]:       <nova:ports>
Nov 11 01:51:04 user nova-compute[75215]:         <nova:port uuid="8b338adf-c152-428d-8a6c-67d64c549ae2">
Nov 11 01:51:04 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:51:04 user nova-compute[75215]:         </nova:port>
Nov 11 01:51:04 user nova-compute[75215]:       </nova:ports>
Nov 11 01:51:04 user nova-compute[75215]:     </nova:instance>
Nov 11 01:51:04 user nova-compute[75215]:   </metadata>
Nov 11 01:51:04 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:51:04 user nova-compute[75215]:     <system>
Nov 11 01:51:04 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:51:04 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:51:04 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:51:04 user nova-compute[75215]:       <entry name="serial">0f4e34d2-8602-495d-8b06-e21748b7add1</entry>
Nov 11 01:51:04 user nova-compute[75215]:       <entry name="uuid">0f4e34d2-8602-495d-8b06-e21748b7add1</entry>
Nov 11 01:51:04 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:51:04 user nova-compute[75215]:     </system>
Nov 11 01:51:04 user nova-compute[75215]:   </sysinfo>
Nov 11 01:51:04 user nova-compute[75215]:   <os>
Nov 11 01:51:04 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:51:04 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:51:04 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:51:04 user nova-compute[75215]:   </os>
Nov 11 01:51:04 user nova-compute[75215]:   <features>
Nov 11 01:51:04 user nova-compute[75215]:     <acpi/>
Nov 11 01:51:04 user nova-compute[75215]:     <apic/>
Nov 11 01:51:04 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:51:04 user nova-compute[75215]:   </features>
Nov 11 01:51:04 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:51:04 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:51:04 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:51:04 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:51:04 user nova-compute[75215]:   </clock>
Nov 11 01:51:04 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:51:04 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:51:04 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:51:04 user nova-compute[75215]:   </cpu>
Nov 11 01:51:04 user nova-compute[75215]:   <devices>
Nov 11 01:51:04 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:51:04 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:51:04 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk"/>
Nov 11 01:51:04 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:51:04 user nova-compute[75215]:     </disk>
Nov 11 01:51:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:51:04 user nova-compute[75215]:       <mac address="fa:16:3e:0d:c1:9b"/>
Nov 11 01:51:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:51:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:51:04 user nova-compute[75215]:       <target dev="tap8b338adf-c1"/>
Nov 11 01:51:04 user nova-compute[75215]:     </interface>
Nov 11 01:51:04 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:51:04 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/console.log" append="off"/>
Nov 11 01:51:04 user nova-compute[75215]:     </serial>
Nov 11 01:51:04 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:51:04 user nova-compute[75215]:     <video>
Nov 11 01:51:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:51:04 user nova-compute[75215]:     </video>
Nov 11 01:51:04 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:51:04 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:51:04 user nova-compute[75215]:     </rng>
Nov 11 01:51:04 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:51:04 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:51:04 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:51:04 user nova-compute[75215]:     </memballoon>
Nov 11 01:51:04 user nova-compute[75215]:   </devices>
Nov 11 01:51:04 user nova-compute[75215]: </domain>
Nov 11 01:51:04 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1595293667',display_name='tempest-AttachVolumeNegativeTest-server-1595293667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1595293667',id=37,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdAL6MFmyBLVZf89/7YhI0jOz/e0ovV+HZcl2fih64ibi3XoDHyBAiai+wSf3VdILdzjPRjumq92Y91NZ3wEc7/V7ab6cetPyMJSHx2iqQ4LHNH5hs16MNBAweuIAoqeg==',key_name='tempest-keypair-851723402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-388r3t6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=0f4e34d2-8602-495d-8b06-e21748b7add1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c1:9b,bridge_name='br-int',has_traffic_filtering=True,id=8b338adf-c152-428d-8a6c-67d64c549ae2,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b338adf-c1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG os_vif [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c1:9b,bridge_name='br-int',has_traffic_filtering=True,id=8b338adf-c152-428d-8a6c-67d64c549ae2,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b338adf-c1') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52c7f59b-c913-5372-8f43-575c8c7cc6e2', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b338adf-c1, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b338adf-c1, col_values=(('qos', UUID('92a07af7-c7f7-44bd-b3f2-863dc09db1d0')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b338adf-c1, col_values=(('external_ids', {'iface-id': '8b338adf-c152-428d-8a6c-67d64c549ae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:c1:9b', 'vm-uuid': '0f4e34d2-8602-495d-8b06-e21748b7add1'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:04 user nova-compute[75215]: INFO os_vif [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c1:9b,bridge_name='br-int',has_traffic_filtering=True,id=8b338adf-c152-428d-8a6c-67d64c549ae2,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b338adf-c1')
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No VIF found with MAC fa:16:3e:0d:c1:9b, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-48331f27-1443-4de1-a50c-614788612464 req-7f1d8f72-0db7-4b74-8a1e-b2e0e0ad4fd6 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Updated VIF entry in instance network info cache for port 8b338adf-c152-428d-8a6c-67d64c549ae2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-48331f27-1443-4de1-a50c-614788612464 req-7f1d8f72-0db7-4b74-8a1e-b2e0e0ad4fd6 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Updating instance_info_cache with network_info: [{"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-48331f27-1443-4de1-a50c-614788612464 req-7f1d8f72-0db7-4b74-8a1e-b2e0e0ad4fd6 service nova] Releasing lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:51:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-7dab3a44-4918-495e-8cb4-2a0ef6bb600f req-b2a0f47d-b659-4008-8f61-a45596473c8c service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received event network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7dab3a44-4918-495e-8cb4-2a0ef6bb600f req-b2a0f47d-b659-4008-8f61-a45596473c8c service nova] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7dab3a44-4918-495e-8cb4-2a0ef6bb600f req-b2a0f47d-b659-4008-8f61-a45596473c8c service nova] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7dab3a44-4918-495e-8cb4-2a0ef6bb600f req-b2a0f47d-b659-4008-8f61-a45596473c8c service nova] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-7dab3a44-4918-495e-8cb4-2a0ef6bb600f req-b2a0f47d-b659-4008-8f61-a45596473c8c service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] No waiting events found dispatching network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:51:05 user nova-compute[75215]: WARNING nova.compute.manager [req-7dab3a44-4918-495e-8cb4-2a0ef6bb600f req-b2a0f47d-b659-4008-8f61-a45596473c8c service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received unexpected event network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 for instance with vm_state building and task_state spawning.
Nov 11 01:51:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-8705b2c8-8fd6-4a32-bae7-d683d7711f4c req-4f35ff20-f622-47d8-9457-77a3aa68be15 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received event network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:51:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8705b2c8-8fd6-4a32-bae7-d683d7711f4c req-4f35ff20-f622-47d8-9457-77a3aa68be15 service nova] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8705b2c8-8fd6-4a32-bae7-d683d7711f4c req-4f35ff20-f622-47d8-9457-77a3aa68be15 service nova] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8705b2c8-8fd6-4a32-bae7-d683d7711f4c req-4f35ff20-f622-47d8-9457-77a3aa68be15 service nova] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-8705b2c8-8fd6-4a32-bae7-d683d7711f4c req-4f35ff20-f622-47d8-9457-77a3aa68be15 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] No waiting events found dispatching network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:51:07 user nova-compute[75215]: WARNING nova.compute.manager [req-8705b2c8-8fd6-4a32-bae7-d683d7711f4c req-4f35ff20-f622-47d8-9457-77a3aa68be15 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received unexpected event network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 for instance with vm_state building and task_state spawning.
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:51:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Instance spawned successfully.
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:51:08 user nova-compute[75215]: INFO nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 11 01:51:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:51:08 user nova-compute[75215]: INFO nova.compute.manager [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Took 6.62 seconds to build instance.
Nov 11 01:51:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f3c1cbcb-ec0d-43e4-84ce-97dea5884d96 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.735s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:22 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff69af94-7f3b-4851-a36b-a351fe838c66 is timed out.
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully detached device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the live domain config.
Nov 11 01:51:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImkKfGFx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:51:22 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b79aef-187e-4480-8a35-0227eb016426]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:51:22 user nova-compute[75215]: No targets found.
Nov 11 01:51:22 user nova-compute[75215]: iSNS:
Nov 11 01:51:22 user nova-compute[75215]: No targets found.
Nov 11 01:51:22 user nova-compute[75215]: STATIC:
Nov 11 01:51:22 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5
Nov 11 01:51:22 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:51:22 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:51:22 user nova-compute[75215]: FIRMWARE:
Nov 11 01:51:22 user nova-compute[75215]: No targets found.
Nov 11 01:51:22 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:51:22 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:51:22 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c1ed78-1e62-4a9a-80bf-722e2fcde1ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94465a-9f14-4bc8-bb33-815ff3438d26]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 (non-flash)
Nov 11 01:51:22 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 (non-flash)
Nov 11 01:51:22 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4020f4a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a2313f-ddef-4857-9d29-a2f94a025474]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bd09d6-02f0-4284-9fa1-12752b7e55ae]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf07a67f-3005-4a39-8e19-ac0a7b47cfe9]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[050fbfe8-22c3-46c0-98c2-4b8ee3a736cf]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b678ed98-f9e4-4349-96d5-6fe426635d05]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d21d9-6ae1-4288-a4d0-461439ffe556]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5, portal: 172.16.0.220,3260]
Nov 11 01:51:22 user nova-compute[75215]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5, portal: 172.16.0.220,3260] successful.
Nov 11 01:51:22 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fb2d57e-2dbd-4498-839a-a61939d7b0e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b6606-23e8-45d7-b26f-aaee7a870651]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== disconnect_volume: return (357ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:23 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f9a9911b-4ec1-4343-99c6-7b539c19e833 tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.199s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:51:26 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7739MB free_disk=25.154521942138672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a48d0e4a-e786-43b9-aee9-20ba981b83fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19c9f240-3967-4387-bac5-0e6fb79e13af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0f4e34d2-8602-495d-8b06-e21748b7add1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 01:51:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 01:51:27 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:51:27 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:51:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:51:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updating instance_info_cache with network_info: [{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:51:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-9a528a94-6f84-4e96-80aa-22bbe21af1b3 req-e79223a2-c912-4891-9c34-c1100332e56d service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-changed-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-9a528a94-6f84-4e96-80aa-22bbe21af1b3 req-e79223a2-c912-4891-9c34-c1100332e56d service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Refreshing instance network info cache due to event network-changed-6cafb810-c1ab-420c-8d1d-810e0abd2a5d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9a528a94-6f84-4e96-80aa-22bbe21af1b3 req-e79223a2-c912-4891-9c34-c1100332e56d service nova] Acquiring lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9a528a94-6f84-4e96-80aa-22bbe21af1b3 req-e79223a2-c912-4891-9c34-c1100332e56d service nova] Acquired lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-9a528a94-6f84-4e96-80aa-22bbe21af1b3 req-e79223a2-c912-4891-9c34-c1100332e56d service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Refreshing network info cache for port 6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG nova.objects.instance [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'flavor' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:51:38 user nova-compute[75215]: INFO nova.compute.manager [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Attaching volume da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 to /dev/vdb
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG os_brick.utils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca864395-d00a-4cc4-9531-fa5bfae9d3e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8513546-161f-427d-b377-fa6cd31a37b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a208bd-646f-4b66-9a32-055c6c01b68c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e135636-972a-45af-8f24-19f7ed41a4ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:51:38 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd54344-0b28-4bd6-8222-6b3938a79e0b]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG os_brick.utils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating existing volume attachment record: 13a02129-1143-4ab5-991f-b0548c5fa89d {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-9a528a94-6f84-4e96-80aa-22bbe21af1b3 req-e79223a2-c912-4891-9c34-c1100332e56d service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updated VIF entry in instance network info cache for port 6cafb810-c1ab-420c-8d1d-810e0abd2a5d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-9a528a94-6f84-4e96-80aa-22bbe21af1b3 req-e79223a2-c912-4891-9c34-c1100332e56d service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:51:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-9a528a94-6f84-4e96-80aa-22bbe21af1b3 req-e79223a2-c912-4891-9c34-c1100332e56d service nova] Releasing lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:51:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZmaNYoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:52:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:52:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:52:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:52:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:52:03 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:52:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[62245cf2-ccf2-4e44-b383-eb51449226e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:52:03 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14628adf-6a4a-4481-9460-3319c9385d06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9] added
Nov 11 01:52:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09f2e7b-1f99-4905-9399-4ef9c5d31ef6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee7ee03-2d41-47f9-ad45-ee711f5b87a4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZmaNYoP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZmaNYoP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3880b400-bb04-40c8-92ef-870b377fcea6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GZmaNYoP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea006b02-d391-49bd-93cd-28bec110de07]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8535a3-15e0-4ceb-a02f-e673cca5bf1f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 01:52:04 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 01:52:04 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:52:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 01:52:04 user nova-compute[75215]: 
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[622c9f9a-7d10-45f2-814d-4ae6b6627dd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9, portal: 172.16.0.220,3260]
Nov 11 01:52:04 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9, portal: 172.16.0.220,3260] successful.
Nov 11 01:52:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2093dfd-ef86-4df2-b7c8-021d0fb4c9fb]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc658d-3cca-46e6-98f8-28e90315cba0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:52:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:52:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[334bb4fa-b29c-45da-bbcd-f46d57d5626a]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZmaNYoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23063313732386164', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063313732386164', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'flavor' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:52:05 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:52:05 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:52:05 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:52:05 user nova-compute[75215]:   <serial>da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9</serial>
Nov 11 01:52:05 user nova-compute[75215]: </disk>
Nov 11 01:52:05 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No VIF found with MAC fa:16:3e:b9:b6:15, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:52:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-67803395-f392-4987-ae2d-103d75db7d5f tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.532s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:06 user nova-compute[75215]: INFO nova.compute.manager [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Rescuing
Nov 11 01:52:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:52:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquired lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:52:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Releasing lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-c28b528a-0459-4217-863f-bd1c1c602141 req-2f359545-a138-43b7-97ae-9bb48360b44b service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c28b528a-0459-4217-863f-bd1c1c602141 req-2f359545-a138-43b7-97ae-9bb48360b44b service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c28b528a-0459-4217-863f-bd1c1c602141 req-2f359545-a138-43b7-97ae-9bb48360b44b service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c28b528a-0459-4217-863f-bd1c1c602141 req-2f359545-a138-43b7-97ae-9bb48360b44b service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-c28b528a-0459-4217-863f-bd1c1c602141 req-2f359545-a138-43b7-97ae-9bb48360b44b service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:52:07 user nova-compute[75215]: WARNING nova.compute.manager [req-c28b528a-0459-4217-863f-bd1c1c602141 req-2f359545-a138-43b7-97ae-9bb48360b44b service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state active and task_state rescuing.
Nov 11 01:52:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance destroyed successfully.
Nov 11 01:52:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Attempting rescue
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75215) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance directory exists: not creating {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 01:52:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Creating image(s)
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'trusted_certs' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.236s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue" returned: 0 in 0.056s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'migration_context' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<180b30c6-7d87-44a6-ab5a-305fd8d20dbd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Start _get_guest_xml network_info=[{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:b9:b6:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'resources' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<180b30c6-7d87-44a6-ab5a-305fd8d20dbd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'numa_topology' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<180b30c6-7d87-44a6-ab5a-305fd8d20dbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:52:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:52:08 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'vcpu_model' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<180b30c6-7d87-44a6-ab5a-305fd8d20dbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-145951852',display_name='tempest-ServerRescueNegativeTestJSON-server-145951852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-145951852',id=34,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ449/qav3FEPuXNzb1iK0CzVUc9Wq5/MUO/yH57h6uviMwlJ47BvlUggfmXkzfkhMtW4mAZA3J7v61jwqe9qKMJG/FyJJoZyrWaWQvWr/ZuKUYqdusyzxKd1lXCXImDVA==',key_name='tempest-keypair-2014465418',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-h02sow4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c11f7630148412285910f06eade4923',uuid=180b30c6-7d87-44a6-ab5a-305fd8d20dbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:b9:b6:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "vif_mac": "fa:16:3e:b9:b6:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b6:15,bridge_name='br-int',has_traffic_filtering=True,id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cafb810-c1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'pci_devices' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.objects.base [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Object Instance<180b30c6-7d87-44a6-ab5a-305fd8d20dbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:52:08 user nova-compute[75215]:   <uuid>180b30c6-7d87-44a6-ab5a-305fd8d20dbd</uuid>
Nov 11 01:52:08 user nova-compute[75215]:   <name>instance-00000022</name>
Nov 11 01:52:08 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:52:08 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:52:08 user nova-compute[75215]:   <metadata>
Nov 11 01:52:08 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:52:08 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:52:08 user nova-compute[75215]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-145951852</nova:name>
Nov 11 01:52:08 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:52:08</nova:creationTime>
Nov 11 01:52:08 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:52:08 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:52:08 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:52:08 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:52:08 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:52:08 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:52:08 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:52:08 user nova-compute[75215]:       <nova:owner>
Nov 11 01:52:08 user nova-compute[75215]:         <nova:user uuid="2c11f7630148412285910f06eade4923">tempest-ServerRescueNegativeTestJSON-107483545-project-member</nova:user>
Nov 11 01:52:08 user nova-compute[75215]:         <nova:project uuid="dddded455ac3456e9316603170bb6fea">tempest-ServerRescueNegativeTestJSON-107483545</nova:project>
Nov 11 01:52:08 user nova-compute[75215]:       </nova:owner>
Nov 11 01:52:08 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:52:08 user nova-compute[75215]:       <nova:ports>
Nov 11 01:52:08 user nova-compute[75215]:         <nova:port uuid="6cafb810-c1ab-420c-8d1d-810e0abd2a5d">
Nov 11 01:52:08 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 01:52:08 user nova-compute[75215]:         </nova:port>
Nov 11 01:52:08 user nova-compute[75215]:       </nova:ports>
Nov 11 01:52:08 user nova-compute[75215]:     </nova:instance>
Nov 11 01:52:08 user nova-compute[75215]:   </metadata>
Nov 11 01:52:08 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:52:08 user nova-compute[75215]:     <system>
Nov 11 01:52:08 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:52:08 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:52:08 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:52:08 user nova-compute[75215]:       <entry name="serial">180b30c6-7d87-44a6-ab5a-305fd8d20dbd</entry>
Nov 11 01:52:08 user nova-compute[75215]:       <entry name="uuid">180b30c6-7d87-44a6-ab5a-305fd8d20dbd</entry>
Nov 11 01:52:08 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:52:08 user nova-compute[75215]:     </system>
Nov 11 01:52:08 user nova-compute[75215]:   </sysinfo>
Nov 11 01:52:08 user nova-compute[75215]:   <os>
Nov 11 01:52:08 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:52:08 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:52:08 user nova-compute[75215]:   </os>
Nov 11 01:52:08 user nova-compute[75215]:   <features>
Nov 11 01:52:08 user nova-compute[75215]:     <acpi/>
Nov 11 01:52:08 user nova-compute[75215]:     <apic/>
Nov 11 01:52:08 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:52:08 user nova-compute[75215]:   </features>
Nov 11 01:52:08 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:52:08 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:52:08 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:52:08 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:52:08 user nova-compute[75215]:   </clock>
Nov 11 01:52:08 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:52:08 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:52:08 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:52:08 user nova-compute[75215]:   </cpu>
Nov 11 01:52:08 user nova-compute[75215]:   <devices>
Nov 11 01:52:08 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:52:08 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:52:08 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue"/>
Nov 11 01:52:08 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:52:08 user nova-compute[75215]:     </disk>
Nov 11 01:52:08 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:52:08 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:52:08 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk"/>
Nov 11 01:52:08 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:52:08 user nova-compute[75215]:     </disk>
Nov 11 01:52:08 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:52:08 user nova-compute[75215]:       <mac address="fa:16:3e:b9:b6:15"/>
Nov 11 01:52:08 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:52:08 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:52:08 user nova-compute[75215]:       <target dev="tap6cafb810-c1"/>
Nov 11 01:52:08 user nova-compute[75215]:     </interface>
Nov 11 01:52:08 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:52:08 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/console.log" append="off"/>
Nov 11 01:52:08 user nova-compute[75215]:     </serial>
Nov 11 01:52:08 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:52:08 user nova-compute[75215]:     <video>
Nov 11 01:52:08 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:52:08 user nova-compute[75215]:     </video>
Nov 11 01:52:08 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:52:08 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:52:08 user nova-compute[75215]:     </rng>
Nov 11 01:52:08 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:52:08 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:52:08 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:52:08 user nova-compute[75215]:     </memballoon>
Nov 11 01:52:08 user nova-compute[75215]:   </devices>
Nov 11 01:52:08 user nova-compute[75215]: </domain>
Nov 11 01:52:08 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:52:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance destroyed successfully.
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:52:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] No VIF found with MAC fa:16:3e:b9:b6:15, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:52:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-5b54ea8c-ecd3-4e09-8f99-bb39cad79708 req-e3bd07d4-fec1-4b9e-9437-e064b36b5efd service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b54ea8c-ecd3-4e09-8f99-bb39cad79708 req-e3bd07d4-fec1-4b9e-9437-e064b36b5efd service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b54ea8c-ecd3-4e09-8f99-bb39cad79708 req-e3bd07d4-fec1-4b9e-9437-e064b36b5efd service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5b54ea8c-ecd3-4e09-8f99-bb39cad79708 req-e3bd07d4-fec1-4b9e-9437-e064b36b5efd service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-5b54ea8c-ecd3-4e09-8f99-bb39cad79708 req-e3bd07d4-fec1-4b9e-9437-e064b36b5efd service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:52:09 user nova-compute[75215]: WARNING nova.compute.manager [req-5b54ea8c-ecd3-4e09-8f99-bb39cad79708 req-e3bd07d4-fec1-4b9e-9437-e064b36b5efd service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state active and task_state rescuing.
Nov 11 01:52:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:52:11 user nova-compute[75215]: WARNING nova.compute.manager [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state active and task_state rescuing.
Nov 11 01:52:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:52:11 user nova-compute[75215]: WARNING nova.compute.manager [req-78ae67d6-2dfc-461a-b105-46ddf140e43d req-26dcb18b-40a1-432f-b4ae-d6a47f94130c service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state active and task_state rescuing.
Nov 11 01:52:12 user nova-compute[75215]: DEBUG nova.compute.manager [None req-718b2095-6270-480d-9b5f-12b73bcce698 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:52:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:15 user nova-compute[75215]: INFO nova.compute.manager [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attaching volume d107ba05-8b3b-4455-88ce-852e0addbc1c to /dev/vdb
Nov 11 01:52:15 user nova-compute[75215]: DEBUG os_brick.utils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5769e2-01e7-4a92-9e18-50bb46416334]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77f4fe8-2932-4422-9814-48fa549576d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82ba07a-8493-444e-8eb7-320daa9506df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c64ef2-a338-4206-aaeb-a320ba1f0cc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:52:15 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:52:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a57c8a3-3850-4095-b175-83ae07c11f4d]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG os_brick.utils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:52:15 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating existing volume attachment record: 9af22461-5795-4687-a3a3-c5826714c454 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:52:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:23 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:23 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:52:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:23 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:52:27 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:52:27 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8051MB free_disk=25.138397216796875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a48d0e4a-e786-43b9-aee9-20ba981b83fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19c9f240-3967-4387-bac5-0e6fb79e13af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0f4e34d2-8602-495d-8b06-e21748b7add1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:52:27 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:52:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:52:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:52:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:52:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b20b2b0-e6d4-493e-a849-3b89c1ef53b1 req-bec101fd-9f11-4839-a983-5b40efa851d7 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received event network-changed-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:52:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-8b20b2b0-e6d4-493e-a849-3b89c1ef53b1 req-bec101fd-9f11-4839-a983-5b40efa851d7 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Refreshing instance network info cache due to event network-changed-8470338f-e32a-4529-9cd7-c31a997b29de. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:52:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b20b2b0-e6d4-493e-a849-3b89c1ef53b1 req-bec101fd-9f11-4839-a983-5b40efa851d7 service nova] Acquiring lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:52:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b20b2b0-e6d4-493e-a849-3b89c1ef53b1 req-bec101fd-9f11-4839-a983-5b40efa851d7 service nova] Acquired lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:52:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b20b2b0-e6d4-493e-a849-3b89c1ef53b1 req-bec101fd-9f11-4839-a983-5b40efa851d7 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Refreshing network info cache for port 8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:52:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b20b2b0-e6d4-493e-a849-3b89c1ef53b1 req-bec101fd-9f11-4839-a983-5b40efa851d7 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updated VIF entry in instance network info cache for port 8470338f-e32a-4529-9cd7-c31a997b29de. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:52:32 user nova-compute[75215]: DEBUG nova.network.neutron [req-8b20b2b0-e6d4-493e-a849-3b89c1ef53b1 req-bec101fd-9f11-4839-a983-5b40efa851d7 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updating instance_info_cache with network_info: [{"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:52:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8b20b2b0-e6d4-493e-a849-3b89c1ef53b1 req-bec101fd-9f11-4839-a983-5b40efa851d7 service nova] Releasing lock "refresh_cache-19c9f240-3967-4387-bac5-0e6fb79e13af" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:52:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lazy-loading 'flavor' on Instance uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:34 user nova-compute[75215]: INFO nova.compute.manager [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Attaching volume 5c398b32-57f8-428b-896d-2b90ff101ea0 to /dev/vdb
Nov 11 01:52:34 user nova-compute[75215]: DEBUG os_brick.utils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e657b1-57e1-4513-ae9a-a26028dab383]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5388e9d6-78a5-418a-92f0-a5ac7ccf37ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a962a3a0-77ae-4e5f-8606-79f656fea511]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[570aa5a1-fbb3-4f8f-8c95-dd6321b9a182]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:52:34 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:52:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a3b184-1e63-423e-bf8d-8fe51694eb48]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG os_brick.utils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updating existing volume attachment record: dc48657f-0a9b-4a02-98cc-7e2132f5415f {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:52:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating instance_info_cache with network_info: [{"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-ff69af94-7f3b-4851-a36b-a351fe838c66" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:35 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:52:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:52:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'flavor' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:52:40 user nova-compute[75215]: INFO nova.compute.manager [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Attaching volume 3d525b00-8c42-4927-bce6-1a092095c3b2 to /dev/vdb
Nov 11 01:52:40 user nova-compute[75215]: DEBUG os_brick.utils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0c2d57-7855-414e-b4c6-e78dd45a5fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08f78d9-a42a-4c0a-a1f7-eaa302ea4701]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2919fa52-8f82-400c-970b-ab363507a948]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7feb53-2023-4f5e-969c-267a8cde23b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:52:40 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:52:40 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf5029e-5dbf-4ad2-aa3c-011a5672be5c]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG os_brick.utils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:52:40 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating existing volume attachment record: caf952ff-6703-4639-a00c-00299d79cb52 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:52:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-c7d7d81a-967a-42a4-bd8f-1b7f809bb52c req-65dd63bd-eac6-456b-86a3-f8bbc6bdd7f3 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received event network-changed-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:52:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-c7d7d81a-967a-42a4-bd8f-1b7f809bb52c req-65dd63bd-eac6-456b-86a3-f8bbc6bdd7f3 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Refreshing instance network info cache due to event network-changed-8b338adf-c152-428d-8a6c-67d64c549ae2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:52:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c7d7d81a-967a-42a4-bd8f-1b7f809bb52c req-65dd63bd-eac6-456b-86a3-f8bbc6bdd7f3 service nova] Acquiring lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:52:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c7d7d81a-967a-42a4-bd8f-1b7f809bb52c req-65dd63bd-eac6-456b-86a3-f8bbc6bdd7f3 service nova] Acquired lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:52:52 user nova-compute[75215]: DEBUG nova.network.neutron [req-c7d7d81a-967a-42a4-bd8f-1b7f809bb52c req-65dd63bd-eac6-456b-86a3-f8bbc6bdd7f3 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Refreshing network info cache for port 8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:52:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-c7d7d81a-967a-42a4-bd8f-1b7f809bb52c req-65dd63bd-eac6-456b-86a3-f8bbc6bdd7f3 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Updated VIF entry in instance network info cache for port 8b338adf-c152-428d-8a6c-67d64c549ae2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:52:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-c7d7d81a-967a-42a4-bd8f-1b7f809bb52c req-65dd63bd-eac6-456b-86a3-f8bbc6bdd7f3 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Updating instance_info_cache with network_info: [{"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:52:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c7d7d81a-967a-42a4-bd8f-1b7f809bb52c req-65dd63bd-eac6-456b-86a3-f8bbc6bdd7f3 service nova] Releasing lock "refresh_cache-0f4e34d2-8602-495d-8b06-e21748b7add1" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:52:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:52:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbmSzylh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:53:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:53:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:53:04 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4678c27-a6ed-427f-8e7d-79966f2d64e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:53:04 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a846ed-ef54-4196-8d1b-1b872b5bab67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c] added
Nov 11 01:53:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e78741-1e42-4cb0-9a87-529ef8f43dbb]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe174f48-1467-47ef-8850-84b2ac5102b3]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IbmSzylh {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IbmSzylh" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd42079-f3e2-482f-8c44-189cf5de8d80]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IbmSzylh'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9251d4e-8801-4bc4-b7f2-a1808858d246]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54350e7-0a2a-4a2c-be5d-1adfbd98a9cc]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d945543-21de-4155-beda-d67fd282ee1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c, portal: 172.16.0.220,3260]
Nov 11 01:53:04 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c, portal: 172.16.0.220,3260] successful.
Nov 11 01:53:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2fdccf-f242-4dfd-8274-9c8a3eaf2e4c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff7857-3576-488f-b503-581ea4279cc1]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:04 user nova-compute[75215]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c (non-flash)
Nov 11 01:53:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:04 user nova-compute[75215]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c (non-flash)
Nov 11 01:53:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cf22f9-232c-456b-a595-5b30328e94b6]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbmSzylh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:53:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:53:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23336343136616661', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:53:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336343136616661', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:53:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:53:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:53:05 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:53:05 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:53:05 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:53:05 user nova-compute[75215]:   <serial>d107ba05-8b3b-4455-88ce-852e0addbc1c</serial>
Nov 11 01:53:05 user nova-compute[75215]: </disk>
Nov 11 01:53:05 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:53:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:53:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:53:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] No VIF found with MAC fa:16:3e:fc:42:0d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:53:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-89deab52-e8b4-461e-9a30-26d6fba74b5a tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.368s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:53:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:53:09 user nova-compute[75215]: INFO nova.compute.manager [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Detaching volume d107ba05-8b3b-4455-88ce-852e0addbc1c
Nov 11 01:53:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:09 user nova-compute[75215]: INFO nova.virt.block_device [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Attempting to driver detach volume d107ba05-8b3b-4455-88ce-852e0addbc1c from mountpoint /dev/vdb
Nov 11 01:53:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Attempting to detach device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:53:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:53:09 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:53:09 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:53:09 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:53:09 user nova-compute[75215]:   <serial>d107ba05-8b3b-4455-88ce-852e0addbc1c</serial>
Nov 11 01:53:09 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:53:09 user nova-compute[75215]: </disk>
Nov 11 01:53:09 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:53:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully detached device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the persistent domain config.
Nov 11 01:53:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:53:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:53:09 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:53:09 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:53:09 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:53:09 user nova-compute[75215]:   <serial>d107ba05-8b3b-4455-88ce-852e0addbc1c</serial>
Nov 11 01:53:09 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:53:09 user nova-compute[75215]: </disk>
Nov 11 01:53:09 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:53:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid 0f4e34d2-8602-495d-8b06-e21748b7add1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:53:11 user nova-compute[75215]: INFO nova.compute.manager [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Attaching volume bd959059-4bec-464f-8916-c644e69923fc to /dev/vdb
Nov 11 01:53:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d874b3-1fb2-424f-a6b9-86010a992a6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e2c87b-1473-4928-8d29-c9c2a2e265e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8620e6-aca2-48c2-bdf9-3de59090ffa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc128a1b-d133-4eb7-9127-5ec261c8ca5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:53:11 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:53:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[901685d9-4f3e-4328-9439-f5446058424b]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG os_brick.utils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:53:11 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Updating existing volume attachment record: d3a37fe2-ffc9-49e4-be7f-0020d634f5d9 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:53:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:53:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:53:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:53:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:53:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:53:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:53:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:53:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:53:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8054MB free_disk=25.126964569091797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a48d0e4a-e786-43b9-aee9-20ba981b83fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19c9f240-3967-4387-bac5-0e6fb79e13af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0f4e34d2-8602-495d-8b06-e21748b7add1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff69af94-7f3b-4851-a36b-a351fe838c66 is timed out.
Nov 11 01:53:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully detached device vdb from instance ff69af94-7f3b-4851-a36b-a351fe838c66 from the live domain config.
Nov 11 01:53:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbmSzylh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:53:29 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:53:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec0784-fc09-4012-bb99-7bcc0e6defc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:53:29 user nova-compute[75215]: No targets found.
Nov 11 01:53:29 user nova-compute[75215]: iSNS:
Nov 11 01:53:29 user nova-compute[75215]: No targets found.
Nov 11 01:53:29 user nova-compute[75215]: STATIC:
Nov 11 01:53:29 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9
Nov 11 01:53:29 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:53:29 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:53:29 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c
Nov 11 01:53:29 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:53:29 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:53:29 user nova-compute[75215]: FIRMWARE:
Nov 11 01:53:29 user nova-compute[75215]: No targets found.
Nov 11 01:53:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:53:29 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:53:29 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:53:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c1735-8c22-4fda-b39f-f6cc79288406]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af904ecb-10a9-46c2-869c-4b646d8a63ee]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:30 user nova-compute[75215]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c (non-flash)
Nov 11 01:53:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:30 user nova-compute[75215]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c (non-flash)
Nov 11 01:53:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404435f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[961be7fc-0ca6-41b4-8470-be0a70d75a0d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[10544432-1fca-4099-a659-5481c1639bb4]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b6a76-c519-4fb9-94ce-694bd1a699f2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f36cce-db9f-469e-9ab8-9abeafba5057]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd927169-25da-4be5-9a7d-f57afd2fd962]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[35195120-5906-4313-96ba-ef84d4c7e864]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c, portal: 172.16.0.220,3260]
Nov 11 01:53:30 user nova-compute[75215]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c, portal: 172.16.0.220,3260] successful.
Nov 11 01:53:30 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d107ba05-8b3b-4455-88ce-852e0addbc1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d65b73-28f6-462a-a49b-f21818f9a7a2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] <== disconnect_volume: return (309ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:53:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:53:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:36 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:53:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:53:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:53:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VknOuZSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:53:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:53:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:53:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:53:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:53:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:53:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:53:42 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:53:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5177ab9e-ce52-4bf4-9e28-a4b467b3e1f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:53:42 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a65741-832c-468f-b261-d1fda67324a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0] added
Nov 11 01:53:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acf46b0-1a48-46f5-a42f-9498c45dbf69]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb70b191-2629-4a21-b8a6-80da3bc742df]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VknOuZSE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISfuTEKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:53:43 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VknOuZSE" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d98fa83-21da-4472-83ad-bdcca321cce0]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VknOuZSE'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fddbda-697d-4b3c-9eeb-64c6d61cb912]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6de6a02-c2bb-4a1d-a177-ed716e625b2e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2ee40f-3764-44c8-82d8-47644874bd01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0, portal: 172.16.0.220,3260]
Nov 11 01:53:43 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0, portal: 172.16.0.220,3260] successful.
Nov 11 01:53:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0343386-3f06-4f7b-a786-5b69643d9811]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f550e9-80b0-43f1-a59a-5efa67a3b1fa]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:43 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:53:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:43 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:53:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3fa82-9f61-40bc-a311-3a398b3b3e5e]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VknOuZSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23839346534333065', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839346534333065', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.195s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:53:44 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:53:44 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lazy-loading 'flavor' on Instance uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafb822e-4209-435e-923e-690811ac8e84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:53:44 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:53:44 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:53:44 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:53:44 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:53:44 user nova-compute[75215]:   <serial>5c398b32-57f8-428b-896d-2b90ff101ea0</serial>
Nov 11 01:53:44 user nova-compute[75215]: </disk>
Nov 11 01:53:44 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee49f47a-2f6d-4c67-a188-b620721f8f9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2] added
Nov 11 01:53:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'flavor' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab04830-f751-48ac-b081-3ccf1ddc73e6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d844caac-33c5-48aa-a46d-d5c1f5473513]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISfuTEKO {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3f255a59-dec5-48b7-872a-594b3b1f681b tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.316s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISfuTEKO" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e09f26-f800-430f-b923-1f45fb09f3ef]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ISfuTEKO'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbc1cb3-5e52-4402-8263-497e63707495]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[343f5e41-8e43-4f5a-9ddc-755afd828538]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb54038-a215-401a-8a38-eb32a1f5fa18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260]
Nov 11 01:53:44 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260] successful.
Nov 11 01:53:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc410b4-d1a9-42e3-9805-be9ee8c5159c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b978bc75-3c3b-419f-93b2-58baae1c1a92]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:53:44 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6665776d-b8ec-46b5-9194-aecd1fc81d1a]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISfuTEKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No VIF found with MAC fa:16:3e:79:fc:f5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:53:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0ce35ab8-0ece-47fc-b28b-d0ed47bbd5a9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 70.743s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:53:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] <== connect_volume: return (2540ms) {'type': 'block', 'scsi_wwn': '26333663139356637', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:53:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333663139356637', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:53:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'flavor' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:53:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:53:45 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:53:45 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:53:45 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:53:45 user nova-compute[75215]:   <serial>3d525b00-8c42-4927-bce6-1a092095c3b2</serial>
Nov 11 01:53:45 user nova-compute[75215]: </disk>
Nov 11 01:53:45 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:53:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:53:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:53:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No VIF found with MAC fa:16:3e:25:2f:f5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:53:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b0affbeb-354b-400d-b159-af0df67d18e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.922s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG nova.objects.instance [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lazy-loading 'flavor' on Instance uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:53:48 user nova-compute[75215]: INFO nova.compute.manager [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Attaching volume 5eb09246-e8da-4684-be47-2aa51916956e to /dev/vdc
Nov 11 01:53:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e628bb8c-f486-44b8-afd6-228848c13ea6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3176ccfa-294d-4f4e-b4ff-520b6eaacdf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6febbd-e3fa-4c2e-8092-5b7dfd7ecdf2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1c5fc9-5a8a-44a9-acda-2f61d4ea4e05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:53:48 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:53:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7468b6-c081-480e-89be-8c34fba90515]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:53:48 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updating existing volume attachment record: 5441464c-53c6-4567-89b3-99ddcf564f20 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:53:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:57 user nova-compute[75215]: INFO nova.compute.manager [None req-d115ba36-baf7-4b27-b5b6-74d7dccfbace tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Unrescuing
Nov 11 01:53:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d115ba36-baf7-4b27-b5b6-74d7dccfbace tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:53:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d115ba36-baf7-4b27-b5b6-74d7dccfbace tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquired lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:53:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d115ba36-baf7-4b27-b5b6-74d7dccfbace tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d115ba36-baf7-4b27-b5b6-74d7dccfbace tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d115ba36-baf7-4b27-b5b6-74d7dccfbace tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Releasing lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d115ba36-baf7-4b27-b5b6-74d7dccfbace tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'flavor' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-c3930054-7132-4174-92d6-eb45ff815067 req-70d89a2e-a491-4010-8190-fe985651906e service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3930054-7132-4174-92d6-eb45ff815067 req-70d89a2e-a491-4010-8190-fe985651906e service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3930054-7132-4174-92d6-eb45ff815067 req-70d89a2e-a491-4010-8190-fe985651906e service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c3930054-7132-4174-92d6-eb45ff815067 req-70d89a2e-a491-4010-8190-fe985651906e service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-c3930054-7132-4174-92d6-eb45ff815067 req-70d89a2e-a491-4010-8190-fe985651906e service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:53:58 user nova-compute[75215]: WARNING nova.compute.manager [req-c3930054-7132-4174-92d6-eb45ff815067 req-70d89a2e-a491-4010-8190-fe985651906e service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:53:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:53:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance destroyed successfully.
Nov 11 01:53:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "3618a146-5725-4242-ab35-d5aa86944ad6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "3618a146-5725-4242-ab35-d5aa86944ad6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:54:00 user nova-compute[75215]: INFO nova.compute.claims [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Claim successful on node user
Nov 11 01:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-3de7ea40-3637-4c73-8955-b1a9e983e7dd req-a6567ee5-c77e-4aa3-9f33-d90139b3e9a0 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3de7ea40-3637-4c73-8955-b1a9e983e7dd req-a6567ee5-c77e-4aa3-9f33-d90139b3e9a0 service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3de7ea40-3637-4c73-8955-b1a9e983e7dd req-a6567ee5-c77e-4aa3-9f33-d90139b3e9a0 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3de7ea40-3637-4c73-8955-b1a9e983e7dd req-a6567ee5-c77e-4aa3-9f33-d90139b3e9a0 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-3de7ea40-3637-4c73-8955-b1a9e983e7dd req-a6567ee5-c77e-4aa3-9f33-d90139b3e9a0 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:00 user nova-compute[75215]: WARNING nova.compute.manager [req-3de7ea40-3637-4c73-8955-b1a9e983e7dd req-a6567ee5-c77e-4aa3-9f33-d90139b3e9a0 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:54:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:54:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:54:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:54:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Creating image(s)
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "/opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "/opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "/opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG nova.policy [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd787bfc571844d28b784683e380d1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a8f1103b3d45a2897ed4b0466582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.242s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.261s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk 1073741824" returned: 0 in 0.058s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:54:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Cannot resize image /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Ensure instance console log exists: /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Successfully created port: 578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:02 user nova-compute[75215]: WARNING nova.compute.manager [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:54:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:02 user nova-compute[75215]: WARNING nova.compute.manager [req-10699dcd-0aca-4de5-8843-5f66893e2ee7 req-418543fd-7668-471b-8b06-38d8411a1a98 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state rescued and task_state unrescuing.
Nov 11 01:54:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d115ba36-baf7-4b27-b5b6-74d7dccfbace tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:54:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Successfully updated port: 578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "refresh_cache-3618a146-5725-4242-ab35-d5aa86944ad6" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquired lock "refresh_cache-3618a146-5725-4242-ab35-d5aa86944ad6" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:54:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:54:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-395387eb-683b-47f8-a9d8-f14c645caca9 req-aada5c5d-06ac-49de-a88a-4610752c5d48 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received event network-changed-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-395387eb-683b-47f8-a9d8-f14c645caca9 req-aada5c5d-06ac-49de-a88a-4610752c5d48 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Refreshing instance network info cache due to event network-changed-578a441d-7f70-41f2-b6b2-39f7c21283cb. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:54:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-395387eb-683b-47f8-a9d8-f14c645caca9 req-aada5c5d-06ac-49de-a88a-4610752c5d48 service nova] Acquiring lock "refresh_cache-3618a146-5725-4242-ab35-d5aa86944ad6" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:54:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Updating instance_info_cache with network_info: [{"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Releasing lock "refresh_cache-3618a146-5725-4242-ab35-d5aa86944ad6" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Instance network_info: |[{"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-395387eb-683b-47f8-a9d8-f14c645caca9 req-aada5c5d-06ac-49de-a88a-4610752c5d48 service nova] Acquired lock "refresh_cache-3618a146-5725-4242-ab35-d5aa86944ad6" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-395387eb-683b-47f8-a9d8-f14c645caca9 req-aada5c5d-06ac-49de-a88a-4610752c5d48 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Refreshing network info cache for port 578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Start _get_guest_xml network_info=[{"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:54:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:54:04 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1813159016',display_name='tempest-VolumesNegativeTest-instance-1813159016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1813159016',id=38,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71a8f1103b3d45a2897ed4b0466582be',ramdisk_id='',reservation_id='r-mak26swt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-376993849',owner_user_name='tempest-VolumesNegativeTest-376993849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:54:01Z,user_data=None,user_id='fd787bfc571844d28b784683e380d1ca',uuid=3618a146-5725-4242-ab35-d5aa86944ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Converting VIF {"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:90,bridge_name='br-int',has_traffic_filtering=True,id=578a441d-7f70-41f2-b6b2-39f7c21283cb,network=Network(b20345bd-d071-49dd-9796-3aac050a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578a441d-7f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lazy-loading 'pci_devices' on Instance uuid 3618a146-5725-4242-ab35-d5aa86944ad6 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:54:04 user nova-compute[75215]:   <uuid>3618a146-5725-4242-ab35-d5aa86944ad6</uuid>
Nov 11 01:54:04 user nova-compute[75215]:   <name>instance-00000026</name>
Nov 11 01:54:04 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:54:04 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:54:04 user nova-compute[75215]:   <metadata>
Nov 11 01:54:04 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:54:04 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:54:04 user nova-compute[75215]:       <nova:name>tempest-VolumesNegativeTest-instance-1813159016</nova:name>
Nov 11 01:54:04 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:54:04</nova:creationTime>
Nov 11 01:54:04 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:54:04 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:54:04 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:54:04 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:54:04 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:54:04 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:54:04 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:54:04 user nova-compute[75215]:       <nova:owner>
Nov 11 01:54:04 user nova-compute[75215]:         <nova:user uuid="fd787bfc571844d28b784683e380d1ca">tempest-VolumesNegativeTest-376993849-project-member</nova:user>
Nov 11 01:54:04 user nova-compute[75215]:         <nova:project uuid="71a8f1103b3d45a2897ed4b0466582be">tempest-VolumesNegativeTest-376993849</nova:project>
Nov 11 01:54:04 user nova-compute[75215]:       </nova:owner>
Nov 11 01:54:04 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:54:04 user nova-compute[75215]:       <nova:ports>
Nov 11 01:54:04 user nova-compute[75215]:         <nova:port uuid="578a441d-7f70-41f2-b6b2-39f7c21283cb">
Nov 11 01:54:04 user nova-compute[75215]:           <nova:ip type="fixed" address="192.168.233.166" ipVersion="4"/>
Nov 11 01:54:04 user nova-compute[75215]:         </nova:port>
Nov 11 01:54:04 user nova-compute[75215]:       </nova:ports>
Nov 11 01:54:04 user nova-compute[75215]:     </nova:instance>
Nov 11 01:54:04 user nova-compute[75215]:   </metadata>
Nov 11 01:54:04 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:54:04 user nova-compute[75215]:     <system>
Nov 11 01:54:04 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:54:04 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:54:04 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:54:04 user nova-compute[75215]:       <entry name="serial">3618a146-5725-4242-ab35-d5aa86944ad6</entry>
Nov 11 01:54:04 user nova-compute[75215]:       <entry name="uuid">3618a146-5725-4242-ab35-d5aa86944ad6</entry>
Nov 11 01:54:04 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:54:04 user nova-compute[75215]:     </system>
Nov 11 01:54:04 user nova-compute[75215]:   </sysinfo>
Nov 11 01:54:04 user nova-compute[75215]:   <os>
Nov 11 01:54:04 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:54:04 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:54:04 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:54:04 user nova-compute[75215]:   </os>
Nov 11 01:54:04 user nova-compute[75215]:   <features>
Nov 11 01:54:04 user nova-compute[75215]:     <acpi/>
Nov 11 01:54:04 user nova-compute[75215]:     <apic/>
Nov 11 01:54:04 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:54:04 user nova-compute[75215]:   </features>
Nov 11 01:54:04 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:54:04 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:54:04 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:54:04 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:54:04 user nova-compute[75215]:   </clock>
Nov 11 01:54:04 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:54:04 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:54:04 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:54:04 user nova-compute[75215]:   </cpu>
Nov 11 01:54:04 user nova-compute[75215]:   <devices>
Nov 11 01:54:04 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:54:04 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:54:04 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk"/>
Nov 11 01:54:04 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:54:04 user nova-compute[75215]:     </disk>
Nov 11 01:54:04 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:54:04 user nova-compute[75215]:       <mac address="fa:16:3e:f8:df:90"/>
Nov 11 01:54:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:54:04 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:54:04 user nova-compute[75215]:       <target dev="tap578a441d-7f"/>
Nov 11 01:54:04 user nova-compute[75215]:     </interface>
Nov 11 01:54:04 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:54:04 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/console.log" append="off"/>
Nov 11 01:54:04 user nova-compute[75215]:     </serial>
Nov 11 01:54:04 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:54:04 user nova-compute[75215]:     <video>
Nov 11 01:54:04 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:54:04 user nova-compute[75215]:     </video>
Nov 11 01:54:04 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:54:04 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:54:04 user nova-compute[75215]:     </rng>
Nov 11 01:54:04 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:54:04 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:54:04 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:54:04 user nova-compute[75215]:     </memballoon>
Nov 11 01:54:04 user nova-compute[75215]:   </devices>
Nov 11 01:54:04 user nova-compute[75215]: </domain>
Nov 11 01:54:04 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1813159016',display_name='tempest-VolumesNegativeTest-instance-1813159016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1813159016',id=38,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71a8f1103b3d45a2897ed4b0466582be',ramdisk_id='',reservation_id='r-mak26swt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-376993849',owner_user_name='tempest-VolumesNegativeTest-376993849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:54:01Z,user_data=None,user_id='fd787bfc571844d28b784683e380d1ca',uuid=3618a146-5725-4242-ab35-d5aa86944ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Converting VIF {"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:90,bridge_name='br-int',has_traffic_filtering=True,id=578a441d-7f70-41f2-b6b2-39f7c21283cb,network=Network(b20345bd-d071-49dd-9796-3aac050a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578a441d-7f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG os_vif [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:90,bridge_name='br-int',has_traffic_filtering=True,id=578a441d-7f70-41f2-b6b2-39f7c21283cb,network=Network(b20345bd-d071-49dd-9796-3aac050a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578a441d-7f') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8287ae60-7522-5fe4-8b52-45663c231b3f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap578a441d-7f, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap578a441d-7f, col_values=(('qos', UUID('999ff189-2455-4602-ab6b-1ad00008747e')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap578a441d-7f, col_values=(('external_ids', {'iface-id': '578a441d-7f70-41f2-b6b2-39f7c21283cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:df:90', 'vm-uuid': '3618a146-5725-4242-ab35-d5aa86944ad6'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:04 user nova-compute[75215]: INFO os_vif [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:90,bridge_name='br-int',has_traffic_filtering=True,id=578a441d-7f70-41f2-b6b2-39f7c21283cb,network=Network(b20345bd-d071-49dd-9796-3aac050a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578a441d-7f')
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] No VIF found with MAC fa:16:3e:f8:df:90, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-395387eb-683b-47f8-a9d8-f14c645caca9 req-aada5c5d-06ac-49de-a88a-4610752c5d48 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Updated VIF entry in instance network info cache for port 578a441d-7f70-41f2-b6b2-39f7c21283cb. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-395387eb-683b-47f8-a9d8-f14c645caca9 req-aada5c5d-06ac-49de-a88a-4610752c5d48 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Updating instance_info_cache with network_info: [{"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:54:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-395387eb-683b-47f8-a9d8-f14c645caca9 req-aada5c5d-06ac-49de-a88a-4610752c5d48 service nova] Releasing lock "refresh_cache-3618a146-5725-4242-ab35-d5aa86944ad6" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:54:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-a06c852f-b568-4520-bc05-c9d5b1a3dd3e req-b12bd8b4-8f20-4d80-a9ac-740c564aab39 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received event network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a06c852f-b568-4520-bc05-c9d5b1a3dd3e req-b12bd8b4-8f20-4d80-a9ac-740c564aab39 service nova] Acquiring lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a06c852f-b568-4520-bc05-c9d5b1a3dd3e req-b12bd8b4-8f20-4d80-a9ac-740c564aab39 service nova] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a06c852f-b568-4520-bc05-c9d5b1a3dd3e req-b12bd8b4-8f20-4d80-a9ac-740c564aab39 service nova] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-a06c852f-b568-4520-bc05-c9d5b1a3dd3e req-b12bd8b4-8f20-4d80-a9ac-740c564aab39 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] No waiting events found dispatching network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:06 user nova-compute[75215]: WARNING nova.compute.manager [req-a06c852f-b568-4520-bc05-c9d5b1a3dd3e req-b12bd8b4-8f20-4d80-a9ac-740c564aab39 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received unexpected event network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb for instance with vm_state building and task_state spawning.
Nov 11 01:54:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb2e22ab-9cb9-4414-a921-05c2a7a8d8a3 req-1efecf58-2ae0-4af3-9ea7-1b27c49b37e8 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received event network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb2e22ab-9cb9-4414-a921-05c2a7a8d8a3 req-1efecf58-2ae0-4af3-9ea7-1b27c49b37e8 service nova] Acquiring lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb2e22ab-9cb9-4414-a921-05c2a7a8d8a3 req-1efecf58-2ae0-4af3-9ea7-1b27c49b37e8 service nova] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb2e22ab-9cb9-4414-a921-05c2a7a8d8a3 req-1efecf58-2ae0-4af3-9ea7-1b27c49b37e8 service nova] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb2e22ab-9cb9-4414-a921-05c2a7a8d8a3 req-1efecf58-2ae0-4af3-9ea7-1b27c49b37e8 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] No waiting events found dispatching network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:08 user nova-compute[75215]: WARNING nova.compute.manager [req-fb2e22ab-9cb9-4414-a921-05c2a7a8d8a3 req-1efecf58-2ae0-4af3-9ea7-1b27c49b37e8 service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received unexpected event network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb for instance with vm_state building and task_state spawning.
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:54:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Instance spawned successfully.
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:54:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:54:09 user nova-compute[75215]: INFO nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Took 7.87 seconds to spawn the instance on the hypervisor.
Nov 11 01:54:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:54:09 user nova-compute[75215]: INFO nova.compute.manager [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Took 8.90 seconds to build instance.
Nov 11 01:54:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03023031-25d0-4f54-a2a0-498dc8f90c08 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "3618a146-5725-4242-ab35-d5aa86944ad6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.058s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-493468f1-d07b-4ab6-b02e-90f5ee4aa077 req-cef00a92-e629-484e-9b05-5a0e85efc42d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:13 user nova-compute[75215]: DEBUG nova.compute.manager [req-493468f1-d07b-4ab6-b02e-90f5ee4aa077 req-cef00a92-e629-484e-9b05-5a0e85efc42d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing instance network info cache due to event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-493468f1-d07b-4ab6-b02e-90f5ee4aa077 req-cef00a92-e629-484e-9b05-5a0e85efc42d service nova] Acquiring lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-493468f1-d07b-4ab6-b02e-90f5ee4aa077 req-cef00a92-e629-484e-9b05-5a0e85efc42d service nova] Acquired lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:54:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-493468f1-d07b-4ab6-b02e-90f5ee4aa077 req-cef00a92-e629-484e-9b05-5a0e85efc42d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:54:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-493468f1-d07b-4ab6-b02e-90f5ee4aa077 req-cef00a92-e629-484e-9b05-5a0e85efc42d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updated VIF entry in instance network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:54:13 user nova-compute[75215]: DEBUG nova.network.neutron [req-493468f1-d07b-4ab6-b02e-90f5ee4aa077 req-cef00a92-e629-484e-9b05-5a0e85efc42d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating instance_info_cache with network_info: [{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:54:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-493468f1-d07b-4ab6-b02e-90f5ee4aa077 req-cef00a92-e629-484e-9b05-5a0e85efc42d service nova] Releasing lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIBXOUaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:54:14 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:54:14 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:54:14 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c356791d-d9b9-4166-84a1-594786232352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:54:14 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[142b8906-3431-4e9c-8412-01acf70a451c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc] added
Nov 11 01:54:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c36a2e9-9ac0-4df7-bd05-76b2eb32ab28]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.090s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8329fccc-32bd-4052-96ac-96204b9223e2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MIBXOUaN {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MIBXOUaN" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52620f0-56de-4a03-b762-c3672348a1a2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MIBXOUaN'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c19b8-9af5-4d01-8b49-2a18125f71d1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f15e7aa-6655-4167-99e7-06cc94b1bd42]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f0a122-b73a-47ef-8f36-f0ea1ac777ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc, portal: 172.16.0.220,3260] successful.\n', 'iscsiadm: could not read session targetname: 5\niscsiadm: could not find session info for session37\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc, portal: 172.16.0.220,3260]
Nov 11 01:54:14 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc, portal: 172.16.0.220,3260] successful.
Nov 11 01:54:14 user nova-compute[75215]:  stderr=iscsiadm: could not read session targetname: 5
Nov 11 01:54:14 user nova-compute[75215]: iscsiadm: could not find session info for session37
Nov 11 01:54:14 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfbf3cf-6d48-4287-9346-abf185f5d8b6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d464005-4bc5-4d22-9783-be2b5b125bf1]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde104ba-a5c2-4e14-bbca-3dfcd3fee47f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde104ba-a5c2-4e14-bbca-3dfcd3fee47f (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde104ba-a5c2-4e14-bbca-3dfcd3fee47f (non-flash)
Nov 11 01:54:14 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:14 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.502s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6bd5d6-b468-4d78-a3f1-797cc3ccab39]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:54:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIBXOUaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-af5a6a99-c5bf-42d6-ae98-93054da63761 req-5f5b6de2-03f8-498c-97dd-f84fc7cdaa68 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-af5a6a99-c5bf-42d6-ae98-93054da63761 req-5f5b6de2-03f8-498c-97dd-f84fc7cdaa68 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing instance network info cache due to event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af5a6a99-c5bf-42d6-ae98-93054da63761 req-5f5b6de2-03f8-498c-97dd-f84fc7cdaa68 service nova] Acquiring lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af5a6a99-c5bf-42d6-ae98-93054da63761 req-5f5b6de2-03f8-498c-97dd-f84fc7cdaa68 service nova] Acquired lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-af5a6a99-c5bf-42d6-ae98-93054da63761 req-5f5b6de2-03f8-498c-97dd-f84fc7cdaa68 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.561s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== connect_volume: return (1564ms) {'type': 'block', 'scsi_wwn': '23235663337646136', 'path': '/dev/sdf'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235663337646136', 'path': '/dev/sdf'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:54:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid 0f4e34d2-8602-495d-8b06-e21748b7add1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:54:16 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:54:16 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:54:16 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:54:16 user nova-compute[75215]:   <serial>bd959059-4bec-464f-8916-c644e69923fc</serial>
Nov 11 01:54:16 user nova-compute[75215]: </disk>
Nov 11 01:54:16 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:54:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:54:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:54:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] No VIF found with MAC fa:16:3e:0d:c1:9b, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:54:16 user nova-compute[75215]: DEBUG nova.network.neutron [req-af5a6a99-c5bf-42d6-ae98-93054da63761 req-5f5b6de2-03f8-498c-97dd-f84fc7cdaa68 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updated VIF entry in instance network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:54:16 user nova-compute[75215]: DEBUG nova.network.neutron [req-af5a6a99-c5bf-42d6-ae98-93054da63761 req-5f5b6de2-03f8-498c-97dd-f84fc7cdaa68 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating instance_info_cache with network_info: [{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:54:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-af5a6a99-c5bf-42d6-ae98-93054da63761 req-5f5b6de2-03f8-498c-97dd-f84fc7cdaa68 service nova] Releasing lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:54:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-2be6fad5-3d5e-4698-9c7a-4a093df872cb tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.188s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:17 user nova-compute[75215]: INFO nova.compute.manager [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Detaching volume bd959059-4bec-464f-8916-c644e69923fc
Nov 11 01:54:17 user nova-compute[75215]: INFO nova.virt.block_device [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Attempting to driver detach volume bd959059-4bec-464f-8916-c644e69923fc from mountpoint /dev/vdb
Nov 11 01:54:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Attempting to detach device vdb from instance 0f4e34d2-8602-495d-8b06-e21748b7add1 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:54:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:54:17 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:54:17 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:54:17 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:54:17 user nova-compute[75215]:   <serial>bd959059-4bec-464f-8916-c644e69923fc</serial>
Nov 11 01:54:17 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:54:17 user nova-compute[75215]: </disk>
Nov 11 01:54:17 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:54:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully detached device vdb from instance 0f4e34d2-8602-495d-8b06-e21748b7add1 from the persistent domain config.
Nov 11 01:54:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f4e34d2-8602-495d-8b06-e21748b7add1 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:54:17 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:54:17 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:54:17 user nova-compute[75215]:   <source dev="/dev/sdf"/>
Nov 11 01:54:17 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:54:17 user nova-compute[75215]:   <serial>bd959059-4bec-464f-8916-c644e69923fc</serial>
Nov 11 01:54:17 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:54:17 user nova-compute[75215]: </disk>
Nov 11 01:54:17 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:54:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f4e34d2-8602-495d-8b06-e21748b7add1 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:54:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:54:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:54:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:54:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7913MB free_disk=25.07949447631836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:29 user nova-compute[75215]: INFO nova.compute.manager [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Rebooting instance
Nov 11 01:54:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a48d0e4a-e786-43b9-aee9-20ba981b83fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19c9f240-3967-4387-bac5-0e6fb79e13af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0f4e34d2-8602-495d-8b06-e21748b7add1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 3618a146-5725-4242-ab35-d5aa86944ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquired lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:54:29 user nova-compute[75215]: DEBUG nova.network.neutron [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG nova.network.neutron [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating instance_info_cache with network_info: [{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Releasing lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-7608a841-b44d-4f8c-b4fa-a80dd32149bd req-c8cb4baa-1f1c-48ff-8bca-dfb62966379a service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-unplugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7608a841-b44d-4f8c-b4fa-a80dd32149bd req-c8cb4baa-1f1c-48ff-8bca-dfb62966379a service nova] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7608a841-b44d-4f8c-b4fa-a80dd32149bd req-c8cb4baa-1f1c-48ff-8bca-dfb62966379a service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7608a841-b44d-4f8c-b4fa-a80dd32149bd req-c8cb4baa-1f1c-48ff-8bca-dfb62966379a service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-7608a841-b44d-4f8c-b4fa-a80dd32149bd req-c8cb4baa-1f1c-48ff-8bca-dfb62966379a service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] No waiting events found dispatching network-vif-unplugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:30 user nova-compute[75215]: WARNING nova.compute.manager [req-7608a841-b44d-4f8c-b4fa-a80dd32149bd req-c8cb4baa-1f1c-48ff-8bca-dfb62966379a service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received unexpected event network-vif-unplugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb for instance with vm_state active and task_state reboot_started_hard.
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance destroyed successfully.
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'resources' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1760529250',display_name='tempest-TestMinimumBasicScenario-server-1760529250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1760529250',id=35,image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMTJHla9hRHoawtbC1SkXIq8VVp2tsZeyfGz9fC9EJ34MdVWCZPTOBokWXOnzLWRmZpRJRcL+MXI4/4Hm+AQ19ex8lqXxCo/cyxyFYdIqsbwX0500h77p/fGNIRSaPYRw==',key_name='tempest-TestMinimumBasicScenario-1379367510',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-8555jnjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:54:30Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=a48d0e4a-e786-43b9-aee9-20ba981b83fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_vif [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa26cf620-d5, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c84339e8-287e-4ee7-a552-de0dcca5290e) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:31 user nova-compute[75215]: INFO os_vif [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5')
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISfuTEKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:54:31 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e1f32d-46ae-4edd-bee8-55ef14dd3117]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:54:31 user nova-compute[75215]: No targets found.
Nov 11 01:54:31 user nova-compute[75215]: iSNS:
Nov 11 01:54:31 user nova-compute[75215]: No targets found.
Nov 11 01:54:31 user nova-compute[75215]: STATIC:
Nov 11 01:54:31 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0
Nov 11 01:54:31 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:54:31 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:54:31 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2
Nov 11 01:54:31 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:54:31 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:54:31 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9
Nov 11 01:54:31 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:54:31 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:54:31 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc
Nov 11 01:54:31 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:54:31 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:54:31 user nova-compute[75215]: FIRMWARE:
Nov 11 01:54:31 user nova-compute[75215]: No targets found.
Nov 11 01:54:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:54:31 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:54:31 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0cb1cf-8401-4d88-ba3d-83dd4c2351a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b81407e-4231-4233-a301-79c5456eb750]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40642f8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b5628-a433-4232-ad46-61d2a13c9e06]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6e9530-5393-4b79-a000-f3c9f0843199]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac90fb63-9fd3-4369-9727-43c8a929a140]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e712c61-d80f-4efe-be73-4c0fdf0b0a7d]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a787c6-2432-47cb-90b7-3660a6561c63]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9748a5f-f112-4799-bd35-60c14534968b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260]
Nov 11 01:54:31 user nova-compute[75215]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260] successful.
Nov 11 01:54:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cafc1e2-3b8f-44c3-92af-1a07938a7371]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] <== disconnect_volume: return (347ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Start _get_guest_xml network_info=[{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=28182716-dd48-41ea-8267-0edd8e8cff59,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '28182716-dd48-41ea-8267-0edd8e8cff59'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'caf952ff-6703-4639-a00c-00299d79cb52', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISfuTEKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a48d0e4a-e786-43b9-aee9-20ba981b83fe', 'attached_at': '', 'detached_at': '', 'volume_id': '3d525b00-8c42-4927-bce6-1a092095c3b2', 'serial': '3d525b00-8c42-4927-bce6-1a092095c3b2'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:54:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:54:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=28182716-dd48-41ea-8267-0edd8e8cff59,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.objects.instance [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'vcpu_model' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.objects.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Object Instance<a48d0e4a-e786-43b9-aee9-20ba981b83fe> lazy-loaded attributes: resources,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISfuTEKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:54:31 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:54:31 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:54:31 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a34f71-f79c-4a95-9891-3a1e5a6a54b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:54:31 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2ad643-5253-4aba-9466-29451f98bc68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2] added
Nov 11 01:54:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14616554-dd93-427f-a495-4925038bfb0b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a373284f-7e2b-45ed-a7f7-e0820c073ab2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISfuTEKO {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISfuTEKO" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d0aade-e11d-46e7-a9c4-fee265cbf10c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ISfuTEKO'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4dfaa3-af94-426b-854a-397248bd0861]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9340d1-9f75-4101-baf4-4dd48f309063]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:31 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:31 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:54:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[279fc438-4982-4f59-9a29-e8ea739b104f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260]
Nov 11 01:54:32 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260] successful.
Nov 11 01:54:32 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c3d15b-25ec-4901-a632-01a190397bde]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbc019c-74e0-4c4b-8ceb-fed707b62ed9]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:32 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:32 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:32 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:32 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:32 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:32 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:32 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:32 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec9a102-4c59-4e40-a77b-57a9ff06cadf]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:32 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-1e235b7c-e1c2-429a-81f4-90c21c265ef1 req-234893f6-d0a4-45d2-9aa7-df1b2c5ddcec service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1e235b7c-e1c2-429a-81f4-90c21c265ef1 req-234893f6-d0a4-45d2-9aa7-df1b2c5ddcec service nova] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1e235b7c-e1c2-429a-81f4-90c21c265ef1 req-234893f6-d0a4-45d2-9aa7-df1b2c5ddcec service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1e235b7c-e1c2-429a-81f4-90c21c265ef1 req-234893f6-d0a4-45d2-9aa7-df1b2c5ddcec service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-1e235b7c-e1c2-429a-81f4-90c21c265ef1 req-234893f6-d0a4-45d2-9aa7-df1b2c5ddcec service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] No waiting events found dispatching network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:33 user nova-compute[75215]: WARNING nova.compute.manager [req-1e235b7c-e1c2-429a-81f4-90c21c265ef1 req-234893f6-d0a4-45d2-9aa7-df1b2c5ddcec service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received unexpected event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb for instance with vm_state active and task_state reboot_started_hard.
Nov 11 01:54:33 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISfuTEKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26333663139356637', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333663139356637', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1760529250',display_name='tempest-TestMinimumBasicScenario-server-1760529250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1760529250',id=35,image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMTJHla9hRHoawtbC1SkXIq8VVp2tsZeyfGz9fC9EJ34MdVWCZPTOBokWXOnzLWRmZpRJRcL+MXI4/4Hm+AQ19ex8lqXxCo/cyxyFYdIqsbwX0500h77p/fGNIRSaPYRw==',key_name='tempest-TestMinimumBasicScenario-1379367510',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-8555jnjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:54:30Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=a48d0e4a-e786-43b9-aee9-20ba981b83fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.objects.instance [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'pci_devices' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.objects.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Object Instance<a48d0e4a-e786-43b9-aee9-20ba981b83fe> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:54:33 user nova-compute[75215]:   <uuid>a48d0e4a-e786-43b9-aee9-20ba981b83fe</uuid>
Nov 11 01:54:33 user nova-compute[75215]:   <name>instance-00000023</name>
Nov 11 01:54:33 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:54:33 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:54:33 user nova-compute[75215]:   <metadata>
Nov 11 01:54:33 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:54:33 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:54:33 user nova-compute[75215]:       <nova:name>tempest-TestMinimumBasicScenario-server-1760529250</nova:name>
Nov 11 01:54:33 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:54:31</nova:creationTime>
Nov 11 01:54:33 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:54:33 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:54:33 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:54:33 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:54:33 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:54:33 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:54:33 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:54:33 user nova-compute[75215]:       <nova:owner>
Nov 11 01:54:33 user nova-compute[75215]:         <nova:user uuid="b2b088eb7c0b47b2bc676cbc3f8a1b4c">tempest-TestMinimumBasicScenario-1149206322-project-member</nova:user>
Nov 11 01:54:33 user nova-compute[75215]:         <nova:project uuid="a7bd80ef3ccb4c4e978990e15a2b0dd3">tempest-TestMinimumBasicScenario-1149206322</nova:project>
Nov 11 01:54:33 user nova-compute[75215]:       </nova:owner>
Nov 11 01:54:33 user nova-compute[75215]:       <nova:root type="image" uuid="28182716-dd48-41ea-8267-0edd8e8cff59"/>
Nov 11 01:54:33 user nova-compute[75215]:       <nova:ports>
Nov 11 01:54:33 user nova-compute[75215]:         <nova:port uuid="a26cf620-d53e-48e5-93ba-5ad8393f82fb">
Nov 11 01:54:33 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 01:54:33 user nova-compute[75215]:         </nova:port>
Nov 11 01:54:33 user nova-compute[75215]:       </nova:ports>
Nov 11 01:54:33 user nova-compute[75215]:     </nova:instance>
Nov 11 01:54:33 user nova-compute[75215]:   </metadata>
Nov 11 01:54:33 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:54:33 user nova-compute[75215]:     <system>
Nov 11 01:54:33 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:54:33 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:54:33 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:54:33 user nova-compute[75215]:       <entry name="serial">a48d0e4a-e786-43b9-aee9-20ba981b83fe</entry>
Nov 11 01:54:33 user nova-compute[75215]:       <entry name="uuid">a48d0e4a-e786-43b9-aee9-20ba981b83fe</entry>
Nov 11 01:54:33 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:54:33 user nova-compute[75215]:     </system>
Nov 11 01:54:33 user nova-compute[75215]:   </sysinfo>
Nov 11 01:54:33 user nova-compute[75215]:   <os>
Nov 11 01:54:33 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:54:33 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:54:33 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:54:33 user nova-compute[75215]:   </os>
Nov 11 01:54:33 user nova-compute[75215]:   <features>
Nov 11 01:54:33 user nova-compute[75215]:     <acpi/>
Nov 11 01:54:33 user nova-compute[75215]:     <apic/>
Nov 11 01:54:33 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:54:33 user nova-compute[75215]:   </features>
Nov 11 01:54:33 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:54:33 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:54:33 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:54:33 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:54:33 user nova-compute[75215]:   </clock>
Nov 11 01:54:33 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:54:33 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:54:33 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:54:33 user nova-compute[75215]:   </cpu>
Nov 11 01:54:33 user nova-compute[75215]:   <devices>
Nov 11 01:54:33 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:54:33 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:54:33 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk"/>
Nov 11 01:54:33 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:54:33 user nova-compute[75215]:     </disk>
Nov 11 01:54:33 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:54:33 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:54:33 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 11 01:54:33 user nova-compute[75215]:       <target dev="vdb" bus="virtio"/>
Nov 11 01:54:33 user nova-compute[75215]:       <serial>3d525b00-8c42-4927-bce6-1a092095c3b2</serial>
Nov 11 01:54:33 user nova-compute[75215]:     </disk>
Nov 11 01:54:33 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:54:33 user nova-compute[75215]:       <mac address="fa:16:3e:25:2f:f5"/>
Nov 11 01:54:33 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:54:33 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:54:33 user nova-compute[75215]:       <target dev="tapa26cf620-d5"/>
Nov 11 01:54:33 user nova-compute[75215]:     </interface>
Nov 11 01:54:33 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:54:33 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/console.log" append="off"/>
Nov 11 01:54:33 user nova-compute[75215]:     </serial>
Nov 11 01:54:33 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:54:33 user nova-compute[75215]:     <video>
Nov 11 01:54:33 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:54:33 user nova-compute[75215]:     </video>
Nov 11 01:54:33 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:54:33 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:54:33 user nova-compute[75215]:     </rng>
Nov 11 01:54:33 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:54:33 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:54:33 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:54:33 user nova-compute[75215]:     </memballoon>
Nov 11 01:54:33 user nova-compute[75215]:   </devices>
Nov 11 01:54:33 user nova-compute[75215]: </domain>
Nov 11 01:54:33 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.objects.instance [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'trusted_certs' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.objects.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Object Instance<a48d0e4a-e786-43b9-aee9-20ba981b83fe> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:54:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Cannot resize image /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG nova.objects.instance [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'migration_context' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG nova.objects.base [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Object Instance<a48d0e4a-e786-43b9-aee9-20ba981b83fe> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1760529250',display_name='tempest-TestMinimumBasicScenario-server-1760529250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1760529250',id=35,image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMTJHla9hRHoawtbC1SkXIq8VVp2tsZeyfGz9fC9EJ34MdVWCZPTOBokWXOnzLWRmZpRJRcL+MXI4/4Hm+AQ19ex8lqXxCo/cyxyFYdIqsbwX0500h77p/fGNIRSaPYRw==',key_name='tempest-TestMinimumBasicScenario-1379367510',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-8555jnjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:54:30Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=a48d0e4a-e786-43b9-aee9-20ba981b83fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG os_vif [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e52fd6a2-f515-5f15-ac87-ca26d3818f36', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa26cf620-d5, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa26cf620-d5, col_values=(('qos', UUID('300156fd-1d3d-4814-bcdd-0a8d51edfde6')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa26cf620-d5, col_values=(('external_ids', {'iface-id': 'a26cf620-d53e-48e5-93ba-5ad8393f82fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:2f:f5', 'vm-uuid': 'a48d0e4a-e786-43b9-aee9-20ba981b83fe'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:34 user nova-compute[75215]: INFO os_vif [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5')
Nov 11 01:54:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-fe1caaa4-d942-4a9d-b09a-5dec0e4efced req-e23163de-e18b-46d6-835f-e7d664507749 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fe1caaa4-d942-4a9d-b09a-5dec0e4efced req-e23163de-e18b-46d6-835f-e7d664507749 service nova] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fe1caaa4-d942-4a9d-b09a-5dec0e4efced req-e23163de-e18b-46d6-835f-e7d664507749 service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fe1caaa4-d942-4a9d-b09a-5dec0e4efced req-e23163de-e18b-46d6-835f-e7d664507749 service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-fe1caaa4-d942-4a9d-b09a-5dec0e4efced req-e23163de-e18b-46d6-835f-e7d664507749 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] No waiting events found dispatching network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:35 user nova-compute[75215]: WARNING nova.compute.manager [req-fe1caaa4-d942-4a9d-b09a-5dec0e4efced req-e23163de-e18b-46d6-835f-e7d664507749 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received unexpected event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb for instance with vm_state active and task_state reboot_started_hard.
Nov 11 01:54:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:54:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance rebooted successfully.
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-c04ce8a8-b317-46e4-b040-d5fd2ba3839e req-0da2a5fe-df8b-41dc-b160-53842f546818 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c04ce8a8-b317-46e4-b040-d5fd2ba3839e req-0da2a5fe-df8b-41dc-b160-53842f546818 service nova] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c04ce8a8-b317-46e4-b040-d5fd2ba3839e req-0da2a5fe-df8b-41dc-b160-53842f546818 service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c04ce8a8-b317-46e4-b040-d5fd2ba3839e req-0da2a5fe-df8b-41dc-b160-53842f546818 service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-c04ce8a8-b317-46e4-b040-d5fd2ba3839e req-0da2a5fe-df8b-41dc-b160-53842f546818 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] No waiting events found dispatching network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:54:37 user nova-compute[75215]: WARNING nova.compute.manager [req-c04ce8a8-b317-46e4-b040-d5fd2ba3839e req-0da2a5fe-df8b-41dc-b160-53842f546818 service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received unexpected event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb for instance with vm_state active and task_state reboot_started_hard.
Nov 11 01:54:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-903587cd-e575-4f03-aef9-f51b24ae27cc tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.068s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:38 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0f4e34d2-8602-495d-8b06-e21748b7add1 is timed out.
Nov 11 01:54:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully detached device vdb from instance 0f4e34d2-8602-495d-8b06-e21748b7add1 from the live domain config.
Nov 11 01:54:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIBXOUaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:54:38 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f1d7e-8200-405d-803f-bfc3572428aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:54:38 user nova-compute[75215]: No targets found.
Nov 11 01:54:38 user nova-compute[75215]: iSNS:
Nov 11 01:54:38 user nova-compute[75215]: No targets found.
Nov 11 01:54:38 user nova-compute[75215]: STATIC:
Nov 11 01:54:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0
Nov 11 01:54:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:54:38 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:54:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2
Nov 11 01:54:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:54:38 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:54:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9
Nov 11 01:54:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:54:38 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:54:38 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc
Nov 11 01:54:38 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:54:38 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:54:38 user nova-compute[75215]: FIRMWARE:
Nov 11 01:54:38 user nova-compute[75215]: No targets found.
Nov 11 01:54:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:54:38 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:54:38 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b73670d-6b4f-4f20-97d0-4d70c0d9304e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49a4589-40c3-4401-bc66-c08229415d88]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:38 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:38 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:38 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:38 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:38 user nova-compute[75215]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc (non-flash)
Nov 11 01:54:38 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4020f480d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc'): ({'sdf'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Removing single pathed devices sdf {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4470829f-4d77-4a74-b97b-8ba1d65e7e45]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe9da7d-317c-469c-877a-aba88712b9d1]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Flushing IO for device /dev/sdf {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbae5be-e519-4050-913b-ab405b7fe976]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4a0833-b47a-44a6-b51b-d8a5750e143f]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] SCSI volumes sdf have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[67135b64-676a-4608-9db1-24cb0a3c227f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b82747-8127-44fc-b5d9-dcc6810897ba]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc, portal: 172.16.0.220,3260]
Nov 11 01:54:38 user nova-compute[75215]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc, portal: 172.16.0.220,3260] successful.
Nov 11 01:54:38 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd959059-4bec-464f-8916-c644e69923fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16211eb-994f-4899-b30c-f51fa709ebf5]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] <== disconnect_volume: return (323ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:54:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:54:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'flavor' on Instance uuid 0f4e34d2-8602-495d-8b06-e21748b7add1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-60071c4b-df81-48bc-9157-8a5be42e4d54 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.186s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnJERHxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:54:41 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:54:41 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:54:41 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8e4fe3-4ea3-46af-a4b8-2f10ae326bb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:54:41 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adda592-f21e-4cf9-9cf8-89d6bfea984f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e] added
Nov 11 01:54:41 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c641da-8a89-4199-b2cb-0e710c1a10b8]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[375831ce-e3be-4505-9ca2-e698b07dafaa]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnJERHxm {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnJERHxm" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f932a3e-1c1d-4e92-94bd-5ba8bd13003d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CnJERHxm'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db4ef5-b07a-4f65-9290-9d2103a34a23]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a17aa1-1822-42ed-b7bd-fdaaf2b4094b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:41 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:41 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:41 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:41 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:41 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:41 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:54:41 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9801119-0712-4c47-8dce-4ff84d2b0d8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e, portal: 172.16.0.220,3260]
Nov 11 01:54:42 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e, portal: 172.16.0.220,3260] successful.
Nov 11 01:54:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f71b3a-11f4-44e6-9034-a027873e09ed]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b39c3e-95fd-4ec6-8736-ce69c82fc64d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:42 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:42 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:42 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e (non-flash)
Nov 11 01:54:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:54:42 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:54:42 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:54:42 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e (non-flash)
Nov 11 01:54:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ac52d-ce16-49df-abb1-c9b626127a2e]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:54:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnJERHxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23335303333653531', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335303333653531', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lazy-loading 'flavor' on Instance uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:54:43 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:54:43 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:54:43 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 11 01:54:43 user nova-compute[75215]:   <serial>5eb09246-e8da-4684-be47-2aa51916956e</serial>
Nov 11 01:54:43 user nova-compute[75215]: </disk>
Nov 11 01:54:43 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] No VIF found with MAC fa:16:3e:79:fc:f5, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:54:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-03a36ae6-1b9c-4990-bb09-99b368e67a82 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.536s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:45 user nova-compute[75215]: INFO nova.compute.manager [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Detaching volume 5eb09246-e8da-4684-be47-2aa51916956e
Nov 11 01:54:45 user nova-compute[75215]: INFO nova.virt.block_device [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Attempting to driver detach volume 5eb09246-e8da-4684-be47-2aa51916956e from mountpoint /dev/vdc
Nov 11 01:54:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Attempting to detach device vdc from instance 19c9f240-3967-4387-bac5-0e6fb79e13af from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:54:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:54:45 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:54:45 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:54:45 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 11 01:54:45 user nova-compute[75215]:   <serial>5eb09246-e8da-4684-be47-2aa51916956e</serial>
Nov 11 01:54:45 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 01:54:45 user nova-compute[75215]: </disk>
Nov 11 01:54:45 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:54:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Successfully detached device vdc from instance 19c9f240-3967-4387-bac5-0e6fb79e13af from the persistent domain config.
Nov 11 01:54:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 19c9f240-3967-4387-bac5-0e6fb79e13af from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:54:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:54:45 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:54:45 user nova-compute[75215]:   <source dev="/dev/sde"/>
Nov 11 01:54:45 user nova-compute[75215]:   <target dev="vdc" bus="virtio"/>
Nov 11 01:54:45 user nova-compute[75215]:   <serial>5eb09246-e8da-4684-be47-2aa51916956e</serial>
Nov 11 01:54:45 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 01:54:45 user nova-compute[75215]: </disk>
Nov 11 01:54:45 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:54:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:54:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:54:59 user nova-compute[75215]: INFO nova.compute.claims [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Claim successful on node user
Nov 11 01:54:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:54:59 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:54:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:54:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG nova.policy [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a486927bdc474540820f23ffb8758d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe9e1a46ae4d54973aad68cd3e0816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:55:00 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Creating image(s)
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "/opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "/opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.281s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk 1073741824" returned: 0 in 0.057s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.215s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:00 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Successfully created port: 8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Cannot resize image /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Ensure instance console log exists: /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Successfully updated port: 8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquired lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae19d015-c104-48b2-a222-ae75f66d4508 req-9487dce0-b46f-46a6-b224-5e11132d5b8a service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-changed-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-ae19d015-c104-48b2-a222-ae75f66d4508 req-9487dce0-b46f-46a6-b224-5e11132d5b8a service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Refreshing instance network info cache due to event network-changed-8959d9c4-7a5c-41a3-81db-d3d65bc87f57. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae19d015-c104-48b2-a222-ae75f66d4508 req-9487dce0-b46f-46a6-b224-5e11132d5b8a service nova] Acquiring lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:55:01 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updating instance_info_cache with network_info: [{"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Releasing lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Instance network_info: |[{"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae19d015-c104-48b2-a222-ae75f66d4508 req-9487dce0-b46f-46a6-b224-5e11132d5b8a service nova] Acquired lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-ae19d015-c104-48b2-a222-ae75f66d4508 req-9487dce0-b46f-46a6-b224-5e11132d5b8a service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Refreshing network info cache for port 8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Start _get_guest_xml network_info=[{"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:55:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:55:02 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1033493510',display_name='tempest-TestStampPattern-server-1033493510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1033493510',id=39,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcw1WLcxHGrUZgRTLCyIgVsmMR4VUkGy9pjePScYuTXptsl6Clt/SyEY1h7Lk3D1TqiG4jkLE2ejH3fjVoqyLMcQCmiWHmrdAKLKNMXdQfBFqk3/YOam91kBTpZJVrp1Q==',key_name='tempest-TestStampPattern-1661226900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fe9e1a46ae4d54973aad68cd3e0816',ramdisk_id='',reservation_id='r-te0s8jrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1920847764',owner_user_name='tempest-TestStampPattern-1920847764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:55:00Z,user_data=None,user_id='a486927bdc474540820f23ffb8758d45',uuid=c9b03800-0532-446a-b985-1507e3b4db3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converting VIF {"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e7:0b,bridge_name='br-int',has_traffic_filtering=True,id=8959d9c4-7a5c-41a3-81db-d3d65bc87f57,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8959d9c4-7a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'pci_devices' on Instance uuid c9b03800-0532-446a-b985-1507e3b4db3e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:55:02 user nova-compute[75215]:   <uuid>c9b03800-0532-446a-b985-1507e3b4db3e</uuid>
Nov 11 01:55:02 user nova-compute[75215]:   <name>instance-00000027</name>
Nov 11 01:55:02 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:55:02 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:55:02 user nova-compute[75215]:   <metadata>
Nov 11 01:55:02 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:55:02 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:55:02 user nova-compute[75215]:       <nova:name>tempest-TestStampPattern-server-1033493510</nova:name>
Nov 11 01:55:02 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:55:02</nova:creationTime>
Nov 11 01:55:02 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:55:02 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:55:02 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:55:02 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:55:02 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:55:02 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:55:02 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:55:02 user nova-compute[75215]:       <nova:owner>
Nov 11 01:55:02 user nova-compute[75215]:         <nova:user uuid="a486927bdc474540820f23ffb8758d45">tempest-TestStampPattern-1920847764-project-member</nova:user>
Nov 11 01:55:02 user nova-compute[75215]:         <nova:project uuid="a6fe9e1a46ae4d54973aad68cd3e0816">tempest-TestStampPattern-1920847764</nova:project>
Nov 11 01:55:02 user nova-compute[75215]:       </nova:owner>
Nov 11 01:55:02 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:55:02 user nova-compute[75215]:       <nova:ports>
Nov 11 01:55:02 user nova-compute[75215]:         <nova:port uuid="8959d9c4-7a5c-41a3-81db-d3d65bc87f57">
Nov 11 01:55:02 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:55:02 user nova-compute[75215]:         </nova:port>
Nov 11 01:55:02 user nova-compute[75215]:       </nova:ports>
Nov 11 01:55:02 user nova-compute[75215]:     </nova:instance>
Nov 11 01:55:02 user nova-compute[75215]:   </metadata>
Nov 11 01:55:02 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:55:02 user nova-compute[75215]:     <system>
Nov 11 01:55:02 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:55:02 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:55:02 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:55:02 user nova-compute[75215]:       <entry name="serial">c9b03800-0532-446a-b985-1507e3b4db3e</entry>
Nov 11 01:55:02 user nova-compute[75215]:       <entry name="uuid">c9b03800-0532-446a-b985-1507e3b4db3e</entry>
Nov 11 01:55:02 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:55:02 user nova-compute[75215]:     </system>
Nov 11 01:55:02 user nova-compute[75215]:   </sysinfo>
Nov 11 01:55:02 user nova-compute[75215]:   <os>
Nov 11 01:55:02 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:55:02 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:55:02 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:55:02 user nova-compute[75215]:   </os>
Nov 11 01:55:02 user nova-compute[75215]:   <features>
Nov 11 01:55:02 user nova-compute[75215]:     <acpi/>
Nov 11 01:55:02 user nova-compute[75215]:     <apic/>
Nov 11 01:55:02 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:55:02 user nova-compute[75215]:   </features>
Nov 11 01:55:02 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:55:02 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:55:02 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:55:02 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:55:02 user nova-compute[75215]:   </clock>
Nov 11 01:55:02 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:55:02 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:55:02 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:55:02 user nova-compute[75215]:   </cpu>
Nov 11 01:55:02 user nova-compute[75215]:   <devices>
Nov 11 01:55:02 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:55:02 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:55:02 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk"/>
Nov 11 01:55:02 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:55:02 user nova-compute[75215]:     </disk>
Nov 11 01:55:02 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:55:02 user nova-compute[75215]:       <mac address="fa:16:3e:c5:e7:0b"/>
Nov 11 01:55:02 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:55:02 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:55:02 user nova-compute[75215]:       <target dev="tap8959d9c4-7a"/>
Nov 11 01:55:02 user nova-compute[75215]:     </interface>
Nov 11 01:55:02 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:55:02 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/console.log" append="off"/>
Nov 11 01:55:02 user nova-compute[75215]:     </serial>
Nov 11 01:55:02 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:55:02 user nova-compute[75215]:     <video>
Nov 11 01:55:02 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:55:02 user nova-compute[75215]:     </video>
Nov 11 01:55:02 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:55:02 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:55:02 user nova-compute[75215]:     </rng>
Nov 11 01:55:02 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:55:02 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:55:02 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:55:02 user nova-compute[75215]:     </memballoon>
Nov 11 01:55:02 user nova-compute[75215]:   </devices>
Nov 11 01:55:02 user nova-compute[75215]: </domain>
Nov 11 01:55:02 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1033493510',display_name='tempest-TestStampPattern-server-1033493510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1033493510',id=39,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcw1WLcxHGrUZgRTLCyIgVsmMR4VUkGy9pjePScYuTXptsl6Clt/SyEY1h7Lk3D1TqiG4jkLE2ejH3fjVoqyLMcQCmiWHmrdAKLKNMXdQfBFqk3/YOam91kBTpZJVrp1Q==',key_name='tempest-TestStampPattern-1661226900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fe9e1a46ae4d54973aad68cd3e0816',ramdisk_id='',reservation_id='r-te0s8jrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1920847764',owner_user_name='tempest-TestStampPattern-1920847764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:55:00Z,user_data=None,user_id='a486927bdc474540820f23ffb8758d45',uuid=c9b03800-0532-446a-b985-1507e3b4db3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converting VIF {"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e7:0b,bridge_name='br-int',has_traffic_filtering=True,id=8959d9c4-7a5c-41a3-81db-d3d65bc87f57,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8959d9c4-7a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG os_vif [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e7:0b,bridge_name='br-int',has_traffic_filtering=True,id=8959d9c4-7a5c-41a3-81db-d3d65bc87f57,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8959d9c4-7a') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9839818a-a7e4-5e1b-b00b-db71ce98270b', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8959d9c4-7a, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8959d9c4-7a, col_values=(('qos', UUID('44172088-d743-448f-9bda-122b5da5ea2c')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8959d9c4-7a, col_values=(('external_ids', {'iface-id': '8959d9c4-7a5c-41a3-81db-d3d65bc87f57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:e7:0b', 'vm-uuid': 'c9b03800-0532-446a-b985-1507e3b4db3e'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:02 user nova-compute[75215]: INFO os_vif [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e7:0b,bridge_name='br-int',has_traffic_filtering=True,id=8959d9c4-7a5c-41a3-81db-d3d65bc87f57,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8959d9c4-7a')
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No VIF found with MAC fa:16:3e:c5:e7:0b, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-ae19d015-c104-48b2-a222-ae75f66d4508 req-9487dce0-b46f-46a6-b224-5e11132d5b8a service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updated VIF entry in instance network info cache for port 8959d9c4-7a5c-41a3-81db-d3d65bc87f57. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG nova.network.neutron [req-ae19d015-c104-48b2-a222-ae75f66d4508 req-9487dce0-b46f-46a6-b224-5e11132d5b8a service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updating instance_info_cache with network_info: [{"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ae19d015-c104-48b2-a222-ae75f66d4508 req-9487dce0-b46f-46a6-b224-5e11132d5b8a service nova] Releasing lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:55:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-49e82afc-71bb-4531-b331-c896a0a1e317 req-be2e1864-95ed-4de4-b0e2-add20771122d service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-49e82afc-71bb-4531-b331-c896a0a1e317 req-be2e1864-95ed-4de4-b0e2-add20771122d service nova] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-49e82afc-71bb-4531-b331-c896a0a1e317 req-be2e1864-95ed-4de4-b0e2-add20771122d service nova] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-49e82afc-71bb-4531-b331-c896a0a1e317 req-be2e1864-95ed-4de4-b0e2-add20771122d service nova] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-49e82afc-71bb-4531-b331-c896a0a1e317 req-be2e1864-95ed-4de4-b0e2-add20771122d service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] No waiting events found dispatching network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:03 user nova-compute[75215]: WARNING nova.compute.manager [req-49e82afc-71bb-4531-b331-c896a0a1e317 req-be2e1864-95ed-4de4-b0e2-add20771122d service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received unexpected event network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 for instance with vm_state building and task_state spawning.
Nov 11 01:55:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:05 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 19c9f240-3967-4387-bac5-0e6fb79e13af is timed out.
Nov 11 01:55:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Successfully detached device vdc from instance 19c9f240-3967-4387-bac5-0e6fb79e13af from the live domain config.
Nov 11 01:55:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnJERHxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:55:05 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bec3a5-8480-477d-85d0-a2f6af22fe4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:55:05 user nova-compute[75215]: No targets found.
Nov 11 01:55:05 user nova-compute[75215]: iSNS:
Nov 11 01:55:05 user nova-compute[75215]: No targets found.
Nov 11 01:55:05 user nova-compute[75215]: STATIC:
Nov 11 01:55:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e
Nov 11 01:55:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:55:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:55:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0
Nov 11 01:55:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:55:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:55:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2
Nov 11 01:55:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:55:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:55:05 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9
Nov 11 01:55:05 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:55:05 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:55:05 user nova-compute[75215]: FIRMWARE:
Nov 11 01:55:05 user nova-compute[75215]: No targets found.
Nov 11 01:55:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:55:05 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:55:05 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a857a6-40c3-4992-af41-f4995eefd748]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6a4070-7945-44b5-bd9f-f6195a64d2e5]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:55:05 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:55:05 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:55:05 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e (non-flash)
Nov 11 01:55:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:55:05 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:55:05 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:55:05 user nova-compute[75215]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e (non-flash)
Nov 11 01:55:05 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f406472c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ebfad3-7554-4e8e-87f9-f580e8df0f92]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9747b8-2c68-4d40-be79-02ff2de8db7c]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b733d80b-9144-41e4-8845-32d6be507ac8]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02150825-7702-4387-96a1-3fa873319582]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:55:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4783e088-8565-4c57-a432-a7a646be1ed4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-c1bb6a5d-cc13-4834-960a-3cdba7b81d27 req-b2682029-0df1-409d-afaf-b49f9ab32dcd service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c1bb6a5d-cc13-4834-960a-3cdba7b81d27 req-b2682029-0df1-409d-afaf-b49f9ab32dcd service nova] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c1bb6a5d-cc13-4834-960a-3cdba7b81d27 req-b2682029-0df1-409d-afaf-b49f9ab32dcd service nova] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c1bb6a5d-cc13-4834-960a-3cdba7b81d27 req-b2682029-0df1-409d-afaf-b49f9ab32dcd service nova] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-c1bb6a5d-cc13-4834-960a-3cdba7b81d27 req-b2682029-0df1-409d-afaf-b49f9ab32dcd service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] No waiting events found dispatching network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:06 user nova-compute[75215]: WARNING nova.compute.manager [req-c1bb6a5d-cc13-4834-960a-3cdba7b81d27 req-b2682029-0df1-409d-afaf-b49f9ab32dcd service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received unexpected event network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 for instance with vm_state building and task_state spawning.
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e0896-d44c-41b8-afa8-3e4285a216d7]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e, portal: 172.16.0.220,3260]
Nov 11 01:55:06 user nova-compute[75215]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e, portal: 172.16.0.220,3260] successful.
Nov 11 01:55:06 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:55:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Instance spawned successfully.
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb09246-e8da-4684-be47-2aa51916956e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ce3061-4fbf-488d-9602-3f385daaa303]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] <== disconnect_volume: return (398ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:06 user nova-compute[75215]: INFO nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 11 01:55:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:55:06 user nova-compute[75215]: INFO nova.compute.manager [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Took 7.18 seconds to build instance.
Nov 11 01:55:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e51bf24b-bbfa-417d-bc8f-6a81e4e3ccf6 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.336s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:07 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lazy-loading 'flavor' on Instance uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:55:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c1569319-20af-4ad3-843b-16e730ed1eb9 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.323s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:08 user nova-compute[75215]: INFO nova.compute.manager [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Terminating instance
Nov 11 01:55:08 user nova-compute[75215]: DEBUG nova.compute.manager [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-890f92c5-cc4d-4b57-93fa-268ea538b2cf req-67fed3b4-b7d4-4eca-a9a8-02c379e31819 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received event network-vif-unplugged-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-890f92c5-cc4d-4b57-93fa-268ea538b2cf req-67fed3b4-b7d4-4eca-a9a8-02c379e31819 service nova] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-890f92c5-cc4d-4b57-93fa-268ea538b2cf req-67fed3b4-b7d4-4eca-a9a8-02c379e31819 service nova] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-890f92c5-cc4d-4b57-93fa-268ea538b2cf req-67fed3b4-b7d4-4eca-a9a8-02c379e31819 service nova] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-890f92c5-cc4d-4b57-93fa-268ea538b2cf req-67fed3b4-b7d4-4eca-a9a8-02c379e31819 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] No waiting events found dispatching network-vif-unplugged-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-890f92c5-cc4d-4b57-93fa-268ea538b2cf req-67fed3b4-b7d4-4eca-a9a8-02c379e31819 service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received event network-vif-unplugged-8b338adf-c152-428d-8a6c-67d64c549ae2 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:55:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Instance destroyed successfully.
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.objects.instance [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lazy-loading 'resources' on Instance uuid 0f4e34d2-8602-495d-8b06-e21748b7add1 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1595293667',display_name='tempest-AttachVolumeNegativeTest-server-1595293667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1595293667',id=37,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdAL6MFmyBLVZf89/7YhI0jOz/e0ovV+HZcl2fih64ibi3XoDHyBAiai+wSf3VdILdzjPRjumq92Y91NZ3wEc7/V7ab6cetPyMJSHx2iqQ4LHNH5hs16MNBAweuIAoqeg==',key_name='tempest-keypair-851723402',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:51:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='792836033673405bb7375a08ddc89e18',ramdisk_id='',reservation_id='r-388r3t6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-791087113',owner_user_name='tempest-AttachVolumeNegativeTest-791087113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da821cfc028b48f6864c064b2ea97c02',uuid=0f4e34d2-8602-495d-8b06-e21748b7add1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converting VIF {"id": "8b338adf-c152-428d-8a6c-67d64c549ae2", "address": "fa:16:3e:0d:c1:9b", "network": {"id": "467ef8bc-bbf2-4761-bb98-22778c8768cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-576069370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "792836033673405bb7375a08ddc89e18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b338adf-c1", "ovs_interfaceid": "8b338adf-c152-428d-8a6c-67d64c549ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:c1:9b,bridge_name='br-int',has_traffic_filtering=True,id=8b338adf-c152-428d-8a6c-67d64c549ae2,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b338adf-c1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG os_vif [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:c1:9b,bridge_name='br-int',has_traffic_filtering=True,id=8b338adf-c152-428d-8a6c-67d64c549ae2,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b338adf-c1') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b338adf-c1, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92a07af7-c7f7-44bd-b3f2-863dc09db1d0) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:09 user nova-compute[75215]: INFO os_vif [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:c1:9b,bridge_name='br-int',has_traffic_filtering=True,id=8b338adf-c152-428d-8a6c-67d64c549ae2,network=Network(467ef8bc-bbf2-4761-bb98-22778c8768cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b338adf-c1')
Nov 11 01:55:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Deleting instance files /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1_del
Nov 11 01:55:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Deletion of /opt/stack/data/nova/instances/0f4e34d2-8602-495d-8b06-e21748b7add1_del complete
Nov 11 01:55:09 user nova-compute[75215]: INFO nova.compute.manager [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 11 01:55:09 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:55:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:10 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:10 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Took 1.40 seconds to deallocate network for instance.
Nov 11 01:55:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-f4a58c6f-25c5-4d44-9288-e1bd958b009f req-a393f651-af60-44d8-a1e6-28f68dc8065b service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received event network-vif-deleted-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-344d9027-c4db-4915-baa9-88bba80b68d2 req-11bedc62-ec2a-4e68-b38e-4f64a67858cb service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received event network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-344d9027-c4db-4915-baa9-88bba80b68d2 req-11bedc62-ec2a-4e68-b38e-4f64a67858cb service nova] Acquiring lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-344d9027-c4db-4915-baa9-88bba80b68d2 req-11bedc62-ec2a-4e68-b38e-4f64a67858cb service nova] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-344d9027-c4db-4915-baa9-88bba80b68d2 req-11bedc62-ec2a-4e68-b38e-4f64a67858cb service nova] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-344d9027-c4db-4915-baa9-88bba80b68d2 req-11bedc62-ec2a-4e68-b38e-4f64a67858cb service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] No waiting events found dispatching network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:11 user nova-compute[75215]: WARNING nova.compute.manager [req-344d9027-c4db-4915-baa9-88bba80b68d2 req-11bedc62-ec2a-4e68-b38e-4f64a67858cb service nova] [instance: 0f4e34d2-8602-495d-8b06-e21748b7add1] Received unexpected event network-vif-plugged-8b338adf-c152-428d-8a6c-67d64c549ae2 for instance with vm_state deleted and task_state None.
Nov 11 01:55:11 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:55:11 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:11 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Deleted allocations for instance 0f4e34d2-8602-495d-8b06-e21748b7add1
Nov 11 01:55:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-611e1ed7-6485-4522-bf08-fc7864ac0000 tempest-AttachVolumeNegativeTest-791087113 tempest-AttachVolumeNegativeTest-791087113-project-member] Lock "0f4e34d2-8602-495d-8b06-e21748b7add1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.105s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:25 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:25 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:55:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:55:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7822MB free_disk=25.065261840820312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance ff69af94-7f3b-4851-a36b-a351fe838c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a48d0e4a-e786-43b9-aee9-20ba981b83fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 19c9f240-3967-4387-bac5-0e6fb79e13af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 3618a146-5725-4242-ab35-d5aa86944ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:55:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:55:30 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:55:30 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:55:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:30 user nova-compute[75215]: DEBUG nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:55:31 user nova-compute[75215]: INFO nova.compute.claims [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Claim successful on node user
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.network.neutron [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:55:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.policy [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55e69b0fcf8943a4b3fcb905fb7e02b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d8b6989b5d40399667cb0b36e0caab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:55:31 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Creating image(s)
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "/opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "/opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "/opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk 1073741824" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG nova.network.neutron [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Successfully created port: 652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Cannot resize image /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Ensure instance console log exists: /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Successfully updated port: 652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquired lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-673d72ae-8a2b-4e43-8e60-b4fda9c07cd4 req-5e1af61d-329a-4766-b8ac-f91751a80943 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received event network-changed-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-673d72ae-8a2b-4e43-8e60-b4fda9c07cd4 req-5e1af61d-329a-4766-b8ac-f91751a80943 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Refreshing instance network info cache due to event network-changed-652c0af1-c29a-4917-afad-6f4f51211124. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-673d72ae-8a2b-4e43-8e60-b4fda9c07cd4 req-5e1af61d-329a-4766-b8ac-f91751a80943 service nova] Acquiring lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.neutron [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Updating instance_info_cache with network_info: [{"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Releasing lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Instance network_info: |[{"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-673d72ae-8a2b-4e43-8e60-b4fda9c07cd4 req-5e1af61d-329a-4766-b8ac-f91751a80943 service nova] Acquired lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-673d72ae-8a2b-4e43-8e60-b4fda9c07cd4 req-5e1af61d-329a-4766-b8ac-f91751a80943 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Refreshing network info cache for port 652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Start _get_guest_xml network_info=[{"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:55:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:55:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1068879769',display_name='tempest-VolumesSnapshotTestJSON-instance-1068879769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1068879769',id=40,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPPPkJMmlEMDuslKBccQN+MzKWdizz1xbAFw3q5sXy9ceCqv8GGs3sR88KPwgnpV0bFO2JtRtKygtS05HmVajbuF0qsccSns6m8NtAEJGlP/u3g4Muvz1bO16vVl/XAg==',key_name='tempest-keypair-2026813253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d8b6989b5d40399667cb0b36e0caab',ramdisk_id='',reservation_id='r-azuje9x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-95388186',owner_user_name='tempest-VolumesSnapshotTestJSON-95388186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e69b0fcf8943a4b3fcb905fb7e02b1',uuid=d98d2519-070b-4eca-ab05-be3bd1661c61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converting VIF {"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:10,bridge_name='br-int',has_traffic_filtering=True,id=652c0af1-c29a-4917-afad-6f4f51211124,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652c0af1-c2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.objects.instance [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'pci_devices' on Instance uuid d98d2519-070b-4eca-ab05-be3bd1661c61 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:55:33 user nova-compute[75215]:   <uuid>d98d2519-070b-4eca-ab05-be3bd1661c61</uuid>
Nov 11 01:55:33 user nova-compute[75215]:   <name>instance-00000028</name>
Nov 11 01:55:33 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:55:33 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:55:33 user nova-compute[75215]:   <metadata>
Nov 11 01:55:33 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:55:33 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:55:33 user nova-compute[75215]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1068879769</nova:name>
Nov 11 01:55:33 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:55:33</nova:creationTime>
Nov 11 01:55:33 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:55:33 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:55:33 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:55:33 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:55:33 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:55:33 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:55:33 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:55:33 user nova-compute[75215]:       <nova:owner>
Nov 11 01:55:33 user nova-compute[75215]:         <nova:user uuid="55e69b0fcf8943a4b3fcb905fb7e02b1">tempest-VolumesSnapshotTestJSON-95388186-project-member</nova:user>
Nov 11 01:55:33 user nova-compute[75215]:         <nova:project uuid="e1d8b6989b5d40399667cb0b36e0caab">tempest-VolumesSnapshotTestJSON-95388186</nova:project>
Nov 11 01:55:33 user nova-compute[75215]:       </nova:owner>
Nov 11 01:55:33 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:55:33 user nova-compute[75215]:       <nova:ports>
Nov 11 01:55:33 user nova-compute[75215]:         <nova:port uuid="652c0af1-c29a-4917-afad-6f4f51211124">
Nov 11 01:55:33 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 01:55:33 user nova-compute[75215]:         </nova:port>
Nov 11 01:55:33 user nova-compute[75215]:       </nova:ports>
Nov 11 01:55:33 user nova-compute[75215]:     </nova:instance>
Nov 11 01:55:33 user nova-compute[75215]:   </metadata>
Nov 11 01:55:33 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:55:33 user nova-compute[75215]:     <system>
Nov 11 01:55:33 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:55:33 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:55:33 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:55:33 user nova-compute[75215]:       <entry name="serial">d98d2519-070b-4eca-ab05-be3bd1661c61</entry>
Nov 11 01:55:33 user nova-compute[75215]:       <entry name="uuid">d98d2519-070b-4eca-ab05-be3bd1661c61</entry>
Nov 11 01:55:33 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:55:33 user nova-compute[75215]:     </system>
Nov 11 01:55:33 user nova-compute[75215]:   </sysinfo>
Nov 11 01:55:33 user nova-compute[75215]:   <os>
Nov 11 01:55:33 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:55:33 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:55:33 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:55:33 user nova-compute[75215]:   </os>
Nov 11 01:55:33 user nova-compute[75215]:   <features>
Nov 11 01:55:33 user nova-compute[75215]:     <acpi/>
Nov 11 01:55:33 user nova-compute[75215]:     <apic/>
Nov 11 01:55:33 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:55:33 user nova-compute[75215]:   </features>
Nov 11 01:55:33 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:55:33 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:55:33 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:55:33 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:55:33 user nova-compute[75215]:   </clock>
Nov 11 01:55:33 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:55:33 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:55:33 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:55:33 user nova-compute[75215]:   </cpu>
Nov 11 01:55:33 user nova-compute[75215]:   <devices>
Nov 11 01:55:33 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:55:33 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:55:33 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk"/>
Nov 11 01:55:33 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:55:33 user nova-compute[75215]:     </disk>
Nov 11 01:55:33 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:55:33 user nova-compute[75215]:       <mac address="fa:16:3e:1f:2b:10"/>
Nov 11 01:55:33 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:55:33 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:55:33 user nova-compute[75215]:       <target dev="tap652c0af1-c2"/>
Nov 11 01:55:33 user nova-compute[75215]:     </interface>
Nov 11 01:55:33 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:55:33 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/console.log" append="off"/>
Nov 11 01:55:33 user nova-compute[75215]:     </serial>
Nov 11 01:55:33 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:55:33 user nova-compute[75215]:     <video>
Nov 11 01:55:33 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:55:33 user nova-compute[75215]:     </video>
Nov 11 01:55:33 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:55:33 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:55:33 user nova-compute[75215]:     </rng>
Nov 11 01:55:33 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:55:33 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:55:33 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:55:33 user nova-compute[75215]:     </memballoon>
Nov 11 01:55:33 user nova-compute[75215]:   </devices>
Nov 11 01:55:33 user nova-compute[75215]: </domain>
Nov 11 01:55:33 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1068879769',display_name='tempest-VolumesSnapshotTestJSON-instance-1068879769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1068879769',id=40,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPPPkJMmlEMDuslKBccQN+MzKWdizz1xbAFw3q5sXy9ceCqv8GGs3sR88KPwgnpV0bFO2JtRtKygtS05HmVajbuF0qsccSns6m8NtAEJGlP/u3g4Muvz1bO16vVl/XAg==',key_name='tempest-keypair-2026813253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d8b6989b5d40399667cb0b36e0caab',ramdisk_id='',reservation_id='r-azuje9x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-95388186',owner_user_name='tempest-VolumesSnapshotTestJSON-95388186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e69b0fcf8943a4b3fcb905fb7e02b1',uuid=d98d2519-070b-4eca-ab05-be3bd1661c61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converting VIF {"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:10,bridge_name='br-int',has_traffic_filtering=True,id=652c0af1-c29a-4917-afad-6f4f51211124,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652c0af1-c2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG os_vif [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:10,bridge_name='br-int',has_traffic_filtering=True,id=652c0af1-c29a-4917-afad-6f4f51211124,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652c0af1-c2') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc695c92-9273-5468-a6d7-b837a87be22d', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap652c0af1-c2, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap652c0af1-c2, col_values=(('qos', UUID('69746406-9e96-4f25-900f-79d3f95b8094')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap652c0af1-c2, col_values=(('external_ids', {'iface-id': '652c0af1-c29a-4917-afad-6f4f51211124', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:2b:10', 'vm-uuid': 'd98d2519-070b-4eca-ab05-be3bd1661c61'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:33 user nova-compute[75215]: INFO os_vif [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:10,bridge_name='br-int',has_traffic_filtering=True,id=652c0af1-c29a-4917-afad-6f4f51211124,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652c0af1-c2')
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No VIF found with MAC fa:16:3e:1f:2b:10, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-673d72ae-8a2b-4e43-8e60-b4fda9c07cd4 req-5e1af61d-329a-4766-b8ac-f91751a80943 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Updated VIF entry in instance network info cache for port 652c0af1-c29a-4917-afad-6f4f51211124. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG nova.network.neutron [req-673d72ae-8a2b-4e43-8e60-b4fda9c07cd4 req-5e1af61d-329a-4766-b8ac-f91751a80943 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Updating instance_info_cache with network_info: [{"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-673d72ae-8a2b-4e43-8e60-b4fda9c07cd4 req-5e1af61d-329a-4766-b8ac-f91751a80943 service nova] Releasing lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:55:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-0aca4aa4-ffde-41ec-a6c0-eca1eca6e23d req-c7087745-361a-4a78-8056-da408e74a1d4 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received event network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0aca4aa4-ffde-41ec-a6c0-eca1eca6e23d req-c7087745-361a-4a78-8056-da408e74a1d4 service nova] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0aca4aa4-ffde-41ec-a6c0-eca1eca6e23d req-c7087745-361a-4a78-8056-da408e74a1d4 service nova] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0aca4aa4-ffde-41ec-a6c0-eca1eca6e23d req-c7087745-361a-4a78-8056-da408e74a1d4 service nova] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-0aca4aa4-ffde-41ec-a6c0-eca1eca6e23d req-c7087745-361a-4a78-8056-da408e74a1d4 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] No waiting events found dispatching network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:35 user nova-compute[75215]: WARNING nova.compute.manager [req-0aca4aa4-ffde-41ec-a6c0-eca1eca6e23d req-c7087745-361a-4a78-8056-da408e74a1d4 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received unexpected event network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 for instance with vm_state building and task_state spawning.
Nov 11 01:55:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:35 user nova-compute[75215]: INFO nova.compute.manager [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Detaching volume 5c398b32-57f8-428b-896d-2b90ff101ea0
Nov 11 01:55:35 user nova-compute[75215]: INFO nova.virt.block_device [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Attempting to driver detach volume 5c398b32-57f8-428b-896d-2b90ff101ea0 from mountpoint /dev/vdb
Nov 11 01:55:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Attempting to detach device vdb from instance 19c9f240-3967-4387-bac5-0e6fb79e13af from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:55:35 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:55:35 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:55:35 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:55:35 user nova-compute[75215]:   <serial>5c398b32-57f8-428b-896d-2b90ff101ea0</serial>
Nov 11 01:55:35 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:55:35 user nova-compute[75215]: </disk>
Nov 11 01:55:35 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:55:35 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Successfully detached device vdb from instance 19c9f240-3967-4387-bac5-0e6fb79e13af from the persistent domain config.
Nov 11 01:55:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 19c9f240-3967-4387-bac5-0e6fb79e13af from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:55:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:55:35 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:55:35 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:55:35 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:55:35 user nova-compute[75215]:   <serial>5c398b32-57f8-428b-896d-2b90ff101ea0</serial>
Nov 11 01:55:35 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:55:35 user nova-compute[75215]: </disk>
Nov 11 01:55:35 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:55:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:55:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Instance spawned successfully.
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-15cc784e-e8b1-4bbe-aafc-e7c8c6d792a3 req-e934f3dc-2530-4f03-9c9b-308068226c37 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received event network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15cc784e-e8b1-4bbe-aafc-e7c8c6d792a3 req-e934f3dc-2530-4f03-9c9b-308068226c37 service nova] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15cc784e-e8b1-4bbe-aafc-e7c8c6d792a3 req-e934f3dc-2530-4f03-9c9b-308068226c37 service nova] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-15cc784e-e8b1-4bbe-aafc-e7c8c6d792a3 req-e934f3dc-2530-4f03-9c9b-308068226c37 service nova] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.compute.manager [req-15cc784e-e8b1-4bbe-aafc-e7c8c6d792a3 req-e934f3dc-2530-4f03-9c9b-308068226c37 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] No waiting events found dispatching network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:37 user nova-compute[75215]: WARNING nova.compute.manager [req-15cc784e-e8b1-4bbe-aafc-e7c8c6d792a3 req-e934f3dc-2530-4f03-9c9b-308068226c37 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received unexpected event network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 for instance with vm_state building and task_state spawning.
Nov 11 01:55:37 user nova-compute[75215]: INFO nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:55:37 user nova-compute[75215]: INFO nova.compute.manager [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Took 6.31 seconds to build instance.
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-92582da3-fda8-4f83-b6f1-4b4fe2015e96 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.408s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updating instance_info_cache with network_info: [{"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-2797cb1b-a56d-47c4-9810-4d5cd424c4e9" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:55:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 01:55:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 01:55:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 01:55:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:55:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-80f12fa9-351a-4730-8f9a-c66776fe983f req-5fda8cc4-dc4f-41f9-a34b-6dcb34d63a76 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-changed-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-80f12fa9-351a-4730-8f9a-c66776fe983f req-5fda8cc4-dc4f-41f9-a34b-6dcb34d63a76 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Refreshing instance network info cache due to event network-changed-6cafb810-c1ab-420c-8d1d-810e0abd2a5d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:55:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80f12fa9-351a-4730-8f9a-c66776fe983f req-5fda8cc4-dc4f-41f9-a34b-6dcb34d63a76 service nova] Acquiring lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:55:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80f12fa9-351a-4730-8f9a-c66776fe983f req-5fda8cc4-dc4f-41f9-a34b-6dcb34d63a76 service nova] Acquired lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:55:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-80f12fa9-351a-4730-8f9a-c66776fe983f req-5fda8cc4-dc4f-41f9-a34b-6dcb34d63a76 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Refreshing network info cache for port 6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:55:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:49 user nova-compute[75215]: INFO nova.compute.manager [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Detaching volume da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-80f12fa9-351a-4730-8f9a-c66776fe983f req-5fda8cc4-dc4f-41f9-a34b-6dcb34d63a76 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updated VIF entry in instance network info cache for port 6cafb810-c1ab-420c-8d1d-810e0abd2a5d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.network.neutron [req-80f12fa9-351a-4730-8f9a-c66776fe983f req-5fda8cc4-dc4f-41f9-a34b-6dcb34d63a76 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80f12fa9-351a-4730-8f9a-c66776fe983f req-5fda8cc4-dc4f-41f9-a34b-6dcb34d63a76 service nova] Releasing lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:55:50 user nova-compute[75215]: INFO nova.virt.block_device [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Attempting to driver detach volume da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 from mountpoint /dev/vdb
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Attempting to detach device vdb from instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:55:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:55:50 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:55:50 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:55:50 user nova-compute[75215]:   <serial>da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9</serial>
Nov 11 01:55:50 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:55:50 user nova-compute[75215]: </disk>
Nov 11 01:55:50 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:55:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Successfully detached device vdb from instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd from the persistent domain config.
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:55:50 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:55:50 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:55:50 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:55:50 user nova-compute[75215]:   <serial>da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9</serial>
Nov 11 01:55:50 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:55:50 user nova-compute[75215]: </disk>
Nov 11 01:55:50 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "3618a146-5725-4242-ab35-d5aa86944ad6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "3618a146-5725-4242-ab35-d5aa86944ad6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:50 user nova-compute[75215]: INFO nova.compute.manager [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Terminating instance
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-983228e3-9c99-4dce-8bd7-81fb26a53633 req-5ca2778b-af2f-4ed8-85f4-21a81045adcb service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received event network-vif-unplugged-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-983228e3-9c99-4dce-8bd7-81fb26a53633 req-5ca2778b-af2f-4ed8-85f4-21a81045adcb service nova] Acquiring lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-983228e3-9c99-4dce-8bd7-81fb26a53633 req-5ca2778b-af2f-4ed8-85f4-21a81045adcb service nova] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-983228e3-9c99-4dce-8bd7-81fb26a53633 req-5ca2778b-af2f-4ed8-85f4-21a81045adcb service nova] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-983228e3-9c99-4dce-8bd7-81fb26a53633 req-5ca2778b-af2f-4ed8-85f4-21a81045adcb service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] No waiting events found dispatching network-vif-unplugged-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-983228e3-9c99-4dce-8bd7-81fb26a53633 req-5ca2778b-af2f-4ed8-85f4-21a81045adcb service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received event network-vif-unplugged-578a441d-7f70-41f2-b6b2-39f7c21283cb for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Instance destroyed successfully.
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.objects.instance [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lazy-loading 'resources' on Instance uuid 3618a146-5725-4242-ab35-d5aa86944ad6 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1813159016',display_name='tempest-VolumesNegativeTest-instance-1813159016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1813159016',id=38,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71a8f1103b3d45a2897ed4b0466582be',ramdisk_id='',reservation_id='r-mak26swt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-376993849',owner_user_name='tempest-VolumesNegativeTest-376993849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:54:09Z,user_data=None,user_id='fd787bfc571844d28b784683e380d1ca',uuid=3618a146-5725-4242-ab35-d5aa86944ad6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Converting VIF {"id": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "address": "fa:16:3e:f8:df:90", "network": {"id": "b20345bd-d071-49dd-9796-3aac050a5de1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "344833b5ce954972baeb0fb8e706174f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578a441d-7f", "ovs_interfaceid": "578a441d-7f70-41f2-b6b2-39f7c21283cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:90,bridge_name='br-int',has_traffic_filtering=True,id=578a441d-7f70-41f2-b6b2-39f7c21283cb,network=Network(b20345bd-d071-49dd-9796-3aac050a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578a441d-7f') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG os_vif [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:90,bridge_name='br-int',has_traffic_filtering=True,id=578a441d-7f70-41f2-b6b2-39f7c21283cb,network=Network(b20345bd-d071-49dd-9796-3aac050a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578a441d-7f') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap578a441d-7f, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=999ff189-2455-4602-ab6b-1ad00008747e) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:51 user nova-compute[75215]: INFO os_vif [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:90,bridge_name='br-int',has_traffic_filtering=True,id=578a441d-7f70-41f2-b6b2-39f7c21283cb,network=Network(b20345bd-d071-49dd-9796-3aac050a5de1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578a441d-7f')
Nov 11 01:55:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Deleting instance files /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6_del
Nov 11 01:55:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Deletion of /opt/stack/data/nova/instances/3618a146-5725-4242-ab35-d5aa86944ad6_del complete
Nov 11 01:55:51 user nova-compute[75215]: INFO nova.compute.manager [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 11 01:55:51 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-03537370-673d-4b86-a1fd-7eca8f36deaa req-f6eea398-2de3-4d63-a408-72e4e4bdc9de service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-changed-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-03537370-673d-4b86-a1fd-7eca8f36deaa req-f6eea398-2de3-4d63-a408-72e4e4bdc9de service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Refreshing instance network info cache due to event network-changed-6cafb810-c1ab-420c-8d1d-810e0abd2a5d. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-03537370-673d-4b86-a1fd-7eca8f36deaa req-f6eea398-2de3-4d63-a408-72e4e4bdc9de service nova] Acquiring lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-03537370-673d-4b86-a1fd-7eca8f36deaa req-f6eea398-2de3-4d63-a408-72e4e4bdc9de service nova] Acquired lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-03537370-673d-4b86-a1fd-7eca8f36deaa req-f6eea398-2de3-4d63-a408-72e4e4bdc9de service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Refreshing network info cache for port 6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:51 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Took 0.49 seconds to deallocate network for instance.
Nov 11 01:55:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-03537370-673d-4b86-a1fd-7eca8f36deaa req-f6eea398-2de3-4d63-a408-72e4e4bdc9de service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updated VIF entry in instance network info cache for port 6cafb810-c1ab-420c-8d1d-810e0abd2a5d. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-03537370-673d-4b86-a1fd-7eca8f36deaa req-f6eea398-2de3-4d63-a408-72e4e4bdc9de service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-03537370-673d-4b86-a1fd-7eca8f36deaa req-f6eea398-2de3-4d63-a408-72e4e4bdc9de service nova] Releasing lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:55:52 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Deleted allocations for instance 3618a146-5725-4242-ab35-d5aa86944ad6
Nov 11 01:55:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-01678826-5020-410e-a093-6c22483d9ce9 tempest-VolumesNegativeTest-376993849 tempest-VolumesNegativeTest-376993849-project-member] Lock "3618a146-5725-4242-ab35-d5aa86944ad6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-a4481e81-942e-4fa3-9bf8-fd4395e35ff9 req-1fb1aea6-ae31-4b2d-ba27-10fafa7c608a service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received event network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4481e81-942e-4fa3-9bf8-fd4395e35ff9 req-1fb1aea6-ae31-4b2d-ba27-10fafa7c608a service nova] Acquiring lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4481e81-942e-4fa3-9bf8-fd4395e35ff9 req-1fb1aea6-ae31-4b2d-ba27-10fafa7c608a service nova] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-a4481e81-942e-4fa3-9bf8-fd4395e35ff9 req-1fb1aea6-ae31-4b2d-ba27-10fafa7c608a service nova] Lock "3618a146-5725-4242-ab35-d5aa86944ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-a4481e81-942e-4fa3-9bf8-fd4395e35ff9 req-1fb1aea6-ae31-4b2d-ba27-10fafa7c608a service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] No waiting events found dispatching network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:52 user nova-compute[75215]: WARNING nova.compute.manager [req-a4481e81-942e-4fa3-9bf8-fd4395e35ff9 req-1fb1aea6-ae31-4b2d-ba27-10fafa7c608a service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received unexpected event network-vif-plugged-578a441d-7f70-41f2-b6b2-39f7c21283cb for instance with vm_state deleted and task_state None.
Nov 11 01:55:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-a4481e81-942e-4fa3-9bf8-fd4395e35ff9 req-1fb1aea6-ae31-4b2d-ba27-10fafa7c608a service nova] [instance: 3618a146-5725-4242-ab35-d5aa86944ad6] Received event network-vif-deleted-578a441d-7f70-41f2-b6b2-39f7c21283cb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:56 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 19c9f240-3967-4387-bac5-0e6fb79e13af is timed out.
Nov 11 01:55:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Successfully detached device vdb from instance 19c9f240-3967-4387-bac5-0e6fb79e13af from the live domain config.
Nov 11 01:55:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VknOuZSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:55:56 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa1579b-0827-4303-a922-e8473c09f18e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:55:56 user nova-compute[75215]: No targets found.
Nov 11 01:55:56 user nova-compute[75215]: iSNS:
Nov 11 01:55:56 user nova-compute[75215]: No targets found.
Nov 11 01:55:56 user nova-compute[75215]: STATIC:
Nov 11 01:55:56 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0
Nov 11 01:55:56 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:55:56 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:55:56 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2
Nov 11 01:55:56 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:55:56 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:55:56 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9
Nov 11 01:55:56 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:55:56 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:55:56 user nova-compute[75215]: FIRMWARE:
Nov 11 01:55:56 user nova-compute[75215]: No targets found.
Nov 11 01:55:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:55:56 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:55:56 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[80492d3b-a2c0-41f5-b3c1-58e41ff13b8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1878a5-4556-45c3-b3d7-3682765d6331]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:55:56 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:55:56 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:55:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:55:56 user nova-compute[75215]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 (non-flash)
Nov 11 01:55:56 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:55:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4020f3ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5759b329-329b-4c59-9472-2f1986907c64]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a27ad67-b93d-47e0-b139-57579f8f231a]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[30267e85-9a4a-4282-a7fd-cc7bd03e5295]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[46682587-4012-433e-ae34-2f8a94fa8c92]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e8e925-3539-4149-8cab-baca749f504e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[819dce13-a61f-403b-874f-26578d146cd9]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0, portal: 172.16.0.220,3260]
Nov 11 01:55:56 user nova-compute[75215]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0, portal: 172.16.0.220,3260] successful.
Nov 11 01:55:56 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c398b32-57f8-428b-896d-2b90ff101ea0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e9313a-df4d-4f64-89ea-5df5c5ff0109]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] <== disconnect_volume: return (291ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:55:56 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:55:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lazy-loading 'flavor' on Instance uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:55:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3e002b4b-1895-4e55-86cf-bf8fd170e516 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.007s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:59 user nova-compute[75215]: INFO nova.compute.manager [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Terminating instance
Nov 11 01:55:59 user nova-compute[75215]: DEBUG nova.compute.manager [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-e78711c2-39df-41ad-99ee-c67e3488ab3b req-947a9998-23e5-4521-9f21-f435f12eb72c service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received event network-vif-unplugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e78711c2-39df-41ad-99ee-c67e3488ab3b req-947a9998-23e5-4521-9f21-f435f12eb72c service nova] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e78711c2-39df-41ad-99ee-c67e3488ab3b req-947a9998-23e5-4521-9f21-f435f12eb72c service nova] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e78711c2-39df-41ad-99ee-c67e3488ab3b req-947a9998-23e5-4521-9f21-f435f12eb72c service nova] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-e78711c2-39df-41ad-99ee-c67e3488ab3b req-947a9998-23e5-4521-9f21-f435f12eb72c service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] No waiting events found dispatching network-vif-unplugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-e78711c2-39df-41ad-99ee-c67e3488ab3b req-947a9998-23e5-4521-9f21-f435f12eb72c service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received event network-vif-unplugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:55:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Instance destroyed successfully.
Nov 11 01:55:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lazy-loading 'resources' on Instance uuid ff69af94-7f3b-4851-a36b-a351fe838c66 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1614537940',display_name='tempest-SnapshotDataIntegrityTests-server-1614537940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1614537940',id=30,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN+eJkXS2PypHTPUXSBiSodfTAAuKBII/zDjHioRSePTFvb45jcHpnjZ86URjMMAYOdLuXvRIp95tMrdaviZuIQV95mzyIFPh59DaBagBdfXxjd+KiNDHduHZ3CZVb/QQ==',key_name='tempest-keypair-1426602419',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b408f431cc5b40f39c3e77cb9b625550',ramdisk_id='',reservation_id='r-5cp6s9yf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1286994852',owner_user_name='tempest-SnapshotDataIntegrityTests-1286994852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d021b68204c4fec98a56ec87b8e7d1d',uuid=ff69af94-7f3b-4851-a36b-a351fe838c66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Converting VIF {"id": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "address": "fa:16:3e:fc:42:0d", "network": {"id": "a4a0185c-f23a-4976-a021-3b35017fc71c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2039517011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b408f431cc5b40f39c3e77cb9b625550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47b2f0-69", "ovs_interfaceid": "ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:42:0d,bridge_name='br-int',has_traffic_filtering=True,id=ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2,network=Network(a4a0185c-f23a-4976-a021-3b35017fc71c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47b2f0-69') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG os_vif [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:42:0d,bridge_name='br-int',has_traffic_filtering=True,id=ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2,network=Network(a4a0185c-f23a-4976-a021-3b35017fc71c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47b2f0-69') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef47b2f0-69, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73fc7d8f-35f1-455c-9d39-d08eb0c24568) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:55:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:55:59 user nova-compute[75215]: INFO os_vif [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:42:0d,bridge_name='br-int',has_traffic_filtering=True,id=ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2,network=Network(a4a0185c-f23a-4976-a021-3b35017fc71c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47b2f0-69')
Nov 11 01:55:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Deleting instance files /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66_del
Nov 11 01:55:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Deletion of /opt/stack/data/nova/instances/ff69af94-7f3b-4851-a36b-a351fe838c66_del complete
Nov 11 01:56:00 user nova-compute[75215]: INFO nova.compute.manager [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 11 01:56:00 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:56:00 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:56:00 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:56:00 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:00 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Took 0.81 seconds to deallocate network for instance.
Nov 11 01:56:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:56:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:01 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Deleted allocations for instance ff69af94-7f3b-4851-a36b-a351fe838c66
Nov 11 01:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-fe911c70-af39-4119-9803-ff3e31d794aa tempest-SnapshotDataIntegrityTests-1286994852 tempest-SnapshotDataIntegrityTests-1286994852-project-member] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-76a38b3a-a977-4908-a391-96c7d0ed6d83 req-3e558e91-10d8-412c-9a01-3348e2fb82c1 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received event network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-76a38b3a-a977-4908-a391-96c7d0ed6d83 req-3e558e91-10d8-412c-9a01-3348e2fb82c1 service nova] Acquiring lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-76a38b3a-a977-4908-a391-96c7d0ed6d83 req-3e558e91-10d8-412c-9a01-3348e2fb82c1 service nova] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-76a38b3a-a977-4908-a391-96c7d0ed6d83 req-3e558e91-10d8-412c-9a01-3348e2fb82c1 service nova] Lock "ff69af94-7f3b-4851-a36b-a351fe838c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-76a38b3a-a977-4908-a391-96c7d0ed6d83 req-3e558e91-10d8-412c-9a01-3348e2fb82c1 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] No waiting events found dispatching network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:56:01 user nova-compute[75215]: WARNING nova.compute.manager [req-76a38b3a-a977-4908-a391-96c7d0ed6d83 req-3e558e91-10d8-412c-9a01-3348e2fb82c1 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received unexpected event network-vif-plugged-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 for instance with vm_state deleted and task_state None.
Nov 11 01:56:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-76a38b3a-a977-4908-a391-96c7d0ed6d83 req-3e558e91-10d8-412c-9a01-3348e2fb82c1 service nova] [instance: ff69af94-7f3b-4851-a36b-a351fe838c66] Received event network-vif-deleted-ef47b2f0-69ab-4cdc-9d36-15eb4c2a68c2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid c9b03800-0532-446a-b985-1507e3b4db3e {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid d98d2519-070b-4eca-ab05-be3bd1661c61 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:56:10 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd is timed out.
Nov 11 01:56:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Successfully detached device vdb from instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd from the live domain config.
Nov 11 01:56:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZmaNYoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:56:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e98199-e2b1-4783-be1a-6dd501447f02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:56:10 user nova-compute[75215]: No targets found.
Nov 11 01:56:10 user nova-compute[75215]: iSNS:
Nov 11 01:56:10 user nova-compute[75215]: No targets found.
Nov 11 01:56:10 user nova-compute[75215]: STATIC:
Nov 11 01:56:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2
Nov 11 01:56:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:56:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:56:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9
Nov 11 01:56:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:56:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:56:10 user nova-compute[75215]: FIRMWARE:
Nov 11 01:56:10 user nova-compute[75215]: No targets found.
Nov 11 01:56:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:56:10 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:56:10 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a2d554-5786-4941-8aac-27e86a0129cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b2c4a-a237-49e5-85b3-359fb1c802c6]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:56:10 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:56:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 (non-flash)
Nov 11 01:56:10 user nova-compute[75215]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:56:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4044537010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[981b10c6-12ff-4690-a3d9-71af7f0cebb1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c3a162-2aa6-473b-8cbc-fa41c456938a]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cf50fc-3ec1-41d9-bb2b-9a6b5481407a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a8e55e-157b-4f85-b03f-7297ce604403]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea5f20c-f482-4db0-bac9-a58bd2ecbfc9]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba59c2e-b711-4d83-b6fd-1a88d75daf93]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9, portal: 172.16.0.220,3260]
Nov 11 01:56:10 user nova-compute[75215]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9, portal: 172.16.0.220,3260] successful.
Nov 11 01:56:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4eb1c9-5fc4-4241-8bdb-e93f8f9310f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d556bb2d-79a2-4260-8319-bdd077c3f728]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] <== disconnect_volume: return (298ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:56:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:56:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'flavor' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:56:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c55b69f6-b429-4796-a415-695935dedaaa tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.184s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:56:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-2685e87f-ecdc-4c55-bccf-dce35dee2d1a req-3a285f9c-1896-4544-91ac-23f987abcb5e service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-2685e87f-ecdc-4c55-bccf-dce35dee2d1a req-3a285f9c-1896-4544-91ac-23f987abcb5e service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing instance network info cache due to event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:56:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2685e87f-ecdc-4c55-bccf-dce35dee2d1a req-3a285f9c-1896-4544-91ac-23f987abcb5e service nova] Acquiring lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:56:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2685e87f-ecdc-4c55-bccf-dce35dee2d1a req-3a285f9c-1896-4544-91ac-23f987abcb5e service nova] Acquired lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:56:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-2685e87f-ecdc-4c55-bccf-dce35dee2d1a req-3a285f9c-1896-4544-91ac-23f987abcb5e service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:56:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-2685e87f-ecdc-4c55-bccf-dce35dee2d1a req-3a285f9c-1896-4544-91ac-23f987abcb5e service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updated VIF entry in instance network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:56:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-2685e87f-ecdc-4c55-bccf-dce35dee2d1a req-3a285f9c-1896-4544-91ac-23f987abcb5e service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating instance_info_cache with network_info: [{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2685e87f-ecdc-4c55-bccf-dce35dee2d1a req-3a285f9c-1896-4544-91ac-23f987abcb5e service nova] Releasing lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:56:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-3949ee96-6eac-4730-9fe2-d8b99bbf0aff req-91e903d5-c926-4dfa-a2e4-cd84101fd52d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-3949ee96-6eac-4730-9fe2-d8b99bbf0aff req-91e903d5-c926-4dfa-a2e4-cd84101fd52d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing instance network info cache due to event network-changed-a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:56:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3949ee96-6eac-4730-9fe2-d8b99bbf0aff req-91e903d5-c926-4dfa-a2e4-cd84101fd52d service nova] Acquiring lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:56:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3949ee96-6eac-4730-9fe2-d8b99bbf0aff req-91e903d5-c926-4dfa-a2e4-cd84101fd52d service nova] Acquired lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:56:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-3949ee96-6eac-4730-9fe2-d8b99bbf0aff req-91e903d5-c926-4dfa-a2e4-cd84101fd52d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Refreshing network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:56:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:23 user nova-compute[75215]: INFO nova.compute.manager [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Detaching volume 3d525b00-8c42-4927-bce6-1a092095c3b2
Nov 11 01:56:23 user nova-compute[75215]: INFO nova.virt.block_device [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Attempting to driver detach volume 3d525b00-8c42-4927-bce6-1a092095c3b2 from mountpoint /dev/vdb
Nov 11 01:56:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Attempting to detach device vdb from instance a48d0e4a-e786-43b9-aee9-20ba981b83fe from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:56:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:56:23 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:56:23 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:56:23 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:56:23 user nova-compute[75215]:   <serial>3d525b00-8c42-4927-bce6-1a092095c3b2</serial>
Nov 11 01:56:23 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 01:56:23 user nova-compute[75215]: </disk>
Nov 11 01:56:23 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:56:23 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully detached device vdb from instance a48d0e4a-e786-43b9-aee9-20ba981b83fe from the persistent domain config.
Nov 11 01:56:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a48d0e4a-e786-43b9-aee9-20ba981b83fe from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:56:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:56:23 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:56:23 user nova-compute[75215]:   <source dev="/dev/sdd"/>
Nov 11 01:56:23 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:56:23 user nova-compute[75215]:   <serial>3d525b00-8c42-4927-bce6-1a092095c3b2</serial>
Nov 11 01:56:23 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 01:56:23 user nova-compute[75215]: </disk>
Nov 11 01:56:23 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:56:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-3949ee96-6eac-4730-9fe2-d8b99bbf0aff req-91e903d5-c926-4dfa-a2e4-cd84101fd52d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updated VIF entry in instance network info cache for port a26cf620-d53e-48e5-93ba-5ad8393f82fb. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:56:23 user nova-compute[75215]: DEBUG nova.network.neutron [req-3949ee96-6eac-4730-9fe2-d8b99bbf0aff req-91e903d5-c926-4dfa-a2e4-cd84101fd52d service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating instance_info_cache with network_info: [{"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3949ee96-6eac-4730-9fe2-d8b99bbf0aff req-91e903d5-c926-4dfa-a2e4-cd84101fd52d service nova] Releasing lock "refresh_cache-a48d0e4a-e786-43b9-aee9-20ba981b83fe" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:56:23 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:56:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:26 user nova-compute[75215]: INFO nova.compute.manager [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Terminating instance
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc420786-ecbe-4e3b-a64b-d2c0284011bb req-4644c4ec-333b-4bf2-9d17-929ecb499888 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received event network-vif-unplugged-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc420786-ecbe-4e3b-a64b-d2c0284011bb req-4644c4ec-333b-4bf2-9d17-929ecb499888 service nova] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc420786-ecbe-4e3b-a64b-d2c0284011bb req-4644c4ec-333b-4bf2-9d17-929ecb499888 service nova] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc420786-ecbe-4e3b-a64b-d2c0284011bb req-4644c4ec-333b-4bf2-9d17-929ecb499888 service nova] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc420786-ecbe-4e3b-a64b-d2c0284011bb req-4644c4ec-333b-4bf2-9d17-929ecb499888 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] No waiting events found dispatching network-vif-unplugged-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc420786-ecbe-4e3b-a64b-d2c0284011bb req-4644c4ec-333b-4bf2-9d17-929ecb499888 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received event network-vif-unplugged-8470338f-e32a-4529-9cd7-c31a997b29de for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:56:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Instance destroyed successfully.
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lazy-loading 'resources' on Instance uuid 19c9f240-3967-4387-bac5-0e6fb79e13af {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-156493280',display_name='tempest-TestServerVolumeAttachmentScenario-server-156493280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-156493280',id=36,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3rKqtL4+3Qfd+IWwAfTn40XIJLkX5AM8InfVlc050T4/tcDjYcfiv5+NNY19IKvbnRRx3ELC6lwPjSltPymY0iqX7E1ujAKPuO3E81Ya2xO6/JONuCH0SYVxekg6Ag==',key_name='tempest-keypair-510937134',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63d1ef6255a5493899c6d99db0c98b1a',ramdisk_id='',reservation_id='r-yqo5ahc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-59812108',owner_user_name='tempest-TestServerVolumeAttachmentScenario-59812108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12f927e992bd4ec1b0f4c8b0cd89bd8b',uuid=19c9f240-3967-4387-bac5-0e6fb79e13af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Converting VIF {"id": "8470338f-e32a-4529-9cd7-c31a997b29de", "address": "fa:16:3e:79:fc:f5", "network": {"id": "15731828-095a-4b14-b4a6-53aeb36d1784", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-881433067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d1ef6255a5493899c6d99db0c98b1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8470338f-e3", "ovs_interfaceid": "8470338f-e32a-4529-9cd7-c31a997b29de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:fc:f5,bridge_name='br-int',has_traffic_filtering=True,id=8470338f-e32a-4529-9cd7-c31a997b29de,network=Network(15731828-095a-4b14-b4a6-53aeb36d1784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8470338f-e3') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG os_vif [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:fc:f5,bridge_name='br-int',has_traffic_filtering=True,id=8470338f-e32a-4529-9cd7-c31a997b29de,network=Network(15731828-095a-4b14-b4a6-53aeb36d1784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8470338f-e3') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8470338f-e3, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e921558-13c2-4400-a930-11a15c0ea1df) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:56:26 user nova-compute[75215]: INFO os_vif [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:fc:f5,bridge_name='br-int',has_traffic_filtering=True,id=8470338f-e32a-4529-9cd7-c31a997b29de,network=Network(15731828-095a-4b14-b4a6-53aeb36d1784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8470338f-e3')
Nov 11 01:56:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Deleting instance files /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af_del
Nov 11 01:56:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Deletion of /opt/stack/data/nova/instances/19c9f240-3967-4387-bac5-0e6fb79e13af_del complete
Nov 11 01:56:26 user nova-compute[75215]: INFO nova.compute.manager [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:56:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:27 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-3642f728-9534-4e8a-b69a-a9d6595afaa3 req-761b54a2-6b0d-406f-be92-c8b553d029b1 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received event network-vif-deleted-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:28 user nova-compute[75215]: INFO nova.compute.manager [req-3642f728-9534-4e8a-b69a-a9d6595afaa3 req-761b54a2-6b0d-406f-be92-c8b553d029b1 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Neutron deleted interface 8470338f-e32a-4529-9cd7-c31a997b29de; detaching it from the instance and deleting it from the info cache
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-3642f728-9534-4e8a-b69a-a9d6595afaa3 req-761b54a2-6b0d-406f-be92-c8b553d029b1 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:28 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Took 1.12 seconds to deallocate network for instance.
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-3642f728-9534-4e8a-b69a-a9d6595afaa3 req-761b54a2-6b0d-406f-be92-c8b553d029b1 service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Detach interface failed, port_id=8470338f-e32a-4529-9cd7-c31a997b29de, reason: Instance 19c9f240-3967-4387-bac5-0e6fb79e13af could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-965a1d45-f832-4f32-9ea3-b2452058ef51 req-7c1ea92d-8ff6-42d9-97eb-4c79cb1cdb2c service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received event network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-965a1d45-f832-4f32-9ea3-b2452058ef51 req-7c1ea92d-8ff6-42d9-97eb-4c79cb1cdb2c service nova] Acquiring lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-965a1d45-f832-4f32-9ea3-b2452058ef51 req-7c1ea92d-8ff6-42d9-97eb-4c79cb1cdb2c service nova] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-965a1d45-f832-4f32-9ea3-b2452058ef51 req-7c1ea92d-8ff6-42d9-97eb-4c79cb1cdb2c service nova] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-965a1d45-f832-4f32-9ea3-b2452058ef51 req-7c1ea92d-8ff6-42d9-97eb-4c79cb1cdb2c service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] No waiting events found dispatching network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:56:28 user nova-compute[75215]: WARNING nova.compute.manager [req-965a1d45-f832-4f32-9ea3-b2452058ef51 req-7c1ea92d-8ff6-42d9-97eb-4c79cb1cdb2c service nova] [instance: 19c9f240-3967-4387-bac5-0e6fb79e13af] Received unexpected event network-vif-plugged-8470338f-e32a-4529-9cd7-c31a997b29de for instance with vm_state deleted and task_state None.
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid '19c9f240-3967-4387-bac5-0e6fb79e13af' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid '19c9f240-3967-4387-bac5-0e6fb79e13af' (instance-00000024)
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.685s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:28 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Deleted allocations for instance 19c9f240-3967-4387-bac5-0e6fb79e13af
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6e79867d-9f0e-47cd-9aef-27fc0b15f3e2 tempest-TestServerVolumeAttachmentScenario-59812108 tempest-TestServerVolumeAttachmentScenario-59812108-project-member] Lock "19c9f240-3967-4387-bac5-0e6fb79e13af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.934s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:56:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=7957MB free_disk=25.079959869384766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance a48d0e4a-e786-43b9-aee9-20ba981b83fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d98d2519-070b-4eca-ab05-be3bd1661c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:56:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:56:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:56:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:56:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:56:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [{"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-180b30c6-7d87-44a6-ab5a-305fd8d20dbd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:56:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:56:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:56:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:40 user nova-compute[75215]: INFO nova.compute.manager [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Terminating instance
Nov 11 01:56:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-7299837b-2d0e-4307-9a16-402c591ce3cc req-79064342-5ac1-41d8-b94f-a84dc300e205 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7299837b-2d0e-4307-9a16-402c591ce3cc req-79064342-5ac1-41d8-b94f-a84dc300e205 service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7299837b-2d0e-4307-9a16-402c591ce3cc req-79064342-5ac1-41d8-b94f-a84dc300e205 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7299837b-2d0e-4307-9a16-402c591ce3cc req-79064342-5ac1-41d8-b94f-a84dc300e205 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-7299837b-2d0e-4307-9a16-402c591ce3cc req-79064342-5ac1-41d8-b94f-a84dc300e205 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-7299837b-2d0e-4307-9a16-402c591ce3cc req-79064342-5ac1-41d8-b94f-a84dc300e205 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-unplugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Instance destroyed successfully.
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'resources' on Instance uuid 180b30c6-7d87-44a6-ab5a-305fd8d20dbd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-145951852',display_name='tempest-ServerRescueNegativeTestJSON-server-145951852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-145951852',id=34,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ449/qav3FEPuXNzb1iK0CzVUc9Wq5/MUO/yH57h6uviMwlJ47BvlUggfmXkzfkhMtW4mAZA3J7v61jwqe9qKMJG/FyJJoZyrWaWQvWr/ZuKUYqdusyzxKd1lXCXImDVA==',key_name='tempest-keypair-2014465418',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:52:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-h02sow4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c11f7630148412285910f06eade4923',uuid=180b30c6-7d87-44a6-ab5a-305fd8d20dbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "address": "fa:16:3e:b9:b6:15", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cafb810-c1", "ovs_interfaceid": "6cafb810-c1ab-420c-8d1d-810e0abd2a5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b6:15,bridge_name='br-int',has_traffic_filtering=True,id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cafb810-c1') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG os_vif [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b6:15,bridge_name='br-int',has_traffic_filtering=True,id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cafb810-c1') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cafb810-c1, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c6a8189-4ac9-4b2b-bd71-e34150f1c104) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:56:41 user nova-compute[75215]: INFO os_vif [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:b6:15,bridge_name='br-int',has_traffic_filtering=True,id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cafb810-c1')
Nov 11 01:56:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Deleting instance files /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd_del
Nov 11 01:56:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Deletion of /opt/stack/data/nova/instances/180b30c6-7d87-44a6-ab5a-305fd8d20dbd_del complete
Nov 11 01:56:41 user nova-compute[75215]: INFO nova.compute.manager [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 11 01:56:41 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:41 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Took 0.72 seconds to deallocate network for instance.
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-c68403b0-a567-4dd6-a828-59056990a866 req-8aeae909-cf1a-4af6-b7ed-aced75ba511e service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-deleted-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:41 user nova-compute[75215]: INFO nova.compute.manager [req-c68403b0-a567-4dd6-a828-59056990a866 req-8aeae909-cf1a-4af6-b7ed-aced75ba511e service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Neutron deleted interface 6cafb810-c1ab-420c-8d1d-810e0abd2a5d; detaching it from the instance and deleting it from the info cache
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-c68403b0-a567-4dd6-a828-59056990a866 req-8aeae909-cf1a-4af6-b7ed-aced75ba511e service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-c68403b0-a567-4dd6-a828-59056990a866 req-8aeae909-cf1a-4af6-b7ed-aced75ba511e service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Detach interface failed, port_id=6cafb810-c1ab-420c-8d1d-810e0abd2a5d, reason: Instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:42 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Deleted allocations for instance 180b30c6-7d87-44a6-ab5a-305fd8d20dbd
Nov 11 01:56:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ecbf5bb3-cf56-4e5b-8e70-f4190d6eae9e tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-c4229a7c-5507-47f0-ad5b-b95cabad397d req-824db7ee-8bbd-43c0-ba96-825b34e07256 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c4229a7c-5507-47f0-ad5b-b95cabad397d req-824db7ee-8bbd-43c0-ba96-825b34e07256 service nova] Acquiring lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c4229a7c-5507-47f0-ad5b-b95cabad397d req-824db7ee-8bbd-43c0-ba96-825b34e07256 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c4229a7c-5507-47f0-ad5b-b95cabad397d req-824db7ee-8bbd-43c0-ba96-825b34e07256 service nova] Lock "180b30c6-7d87-44a6-ab5a-305fd8d20dbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-c4229a7c-5507-47f0-ad5b-b95cabad397d req-824db7ee-8bbd-43c0-ba96-825b34e07256 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] No waiting events found dispatching network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:56:42 user nova-compute[75215]: WARNING nova.compute.manager [req-c4229a7c-5507-47f0-ad5b-b95cabad397d req-824db7ee-8bbd-43c0-ba96-825b34e07256 service nova] [instance: 180b30c6-7d87-44a6-ab5a-305fd8d20dbd] Received unexpected event network-vif-plugged-6cafb810-c1ab-420c-8d1d-810e0abd2a5d for instance with vm_state deleted and task_state None.
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:56:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a48d0e4a-e786-43b9-aee9-20ba981b83fe is timed out.
Nov 11 01:56:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully detached device vdb from instance a48d0e4a-e786-43b9-aee9-20ba981b83fe from the live domain config.
Nov 11 01:56:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISfuTEKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:56:43 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dfdece-1128-4cb9-9b6b-91a70273dc5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:56:43 user nova-compute[75215]: No targets found.
Nov 11 01:56:43 user nova-compute[75215]: iSNS:
Nov 11 01:56:43 user nova-compute[75215]: No targets found.
Nov 11 01:56:43 user nova-compute[75215]: STATIC:
Nov 11 01:56:43 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2
Nov 11 01:56:43 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:56:43 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:56:43 user nova-compute[75215]: FIRMWARE:
Nov 11 01:56:43 user nova-compute[75215]: No targets found.
Nov 11 01:56:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:56:43 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:56:43 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f087b6f4-cb78-4f6e-ae13-9ce89f5ffaa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f0a0ed-4138-403e-a53a-79fa1d3660bb]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:56:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 (non-flash)
Nov 11 01:56:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40442a5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a002696e-6670-4589-80ec-89eb4894be79]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f964cb6-e072-4cdd-9bac-f84c40795ebc]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2500f0f-fa8b-4e83-8989-9d262efdead7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[881adfc1-8ccb-443c-9491-d413ec9fa0c9]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf401bc8-76b5-4e58-b1e8-b47c3e5e157e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[388b8f7a-6fb5-494d-84e6-fbb36dd7fd8b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260]
Nov 11 01:56:43 user nova-compute[75215]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2, portal: 172.16.0.220,3260] successful.
Nov 11 01:56:43 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d525b00-8c42-4927-bce6-1a092095c3b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d85a9c5-fbb4-4a3c-8d07-e9eac74ca6c3]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] <== disconnect_volume: return (306ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:56:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:56:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'flavor' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:56:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c8806286-bcf9-4767-999a-11d3afc74320 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.847s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0c419ec-a08a-4b99-8a01-e294ca3e617f req-8a7f31b1-9de9-4254-837c-6c513de5da62 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-changed-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0c419ec-a08a-4b99-8a01-e294ca3e617f req-8a7f31b1-9de9-4254-837c-6c513de5da62 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Refreshing instance network info cache due to event network-changed-8959d9c4-7a5c-41a3-81db-d3d65bc87f57. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0c419ec-a08a-4b99-8a01-e294ca3e617f req-8a7f31b1-9de9-4254-837c-6c513de5da62 service nova] Acquiring lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0c419ec-a08a-4b99-8a01-e294ca3e617f req-8a7f31b1-9de9-4254-837c-6c513de5da62 service nova] Acquired lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-b0c419ec-a08a-4b99-8a01-e294ca3e617f req-8a7f31b1-9de9-4254-837c-6c513de5da62 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Refreshing network info cache for port 8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG nova.objects.instance [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'flavor' on Instance uuid c9b03800-0532-446a-b985-1507e3b4db3e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:56:51 user nova-compute[75215]: INFO nova.compute.manager [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Attaching volume 13c52bbe-4394-44b4-9850-d87a2f709763 to /dev/vdb
Nov 11 01:56:51 user nova-compute[75215]: DEBUG os_brick.utils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4106766-d20e-4f28-a2c5-0ac191afb416]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f786258-d935-4361-8a7c-2e49cab7dd2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-b0c419ec-a08a-4b99-8a01-e294ca3e617f req-8a7f31b1-9de9-4254-837c-6c513de5da62 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updated VIF entry in instance network info cache for port 8959d9c4-7a5c-41a3-81db-d3d65bc87f57. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG nova.network.neutron [req-b0c419ec-a08a-4b99-8a01-e294ca3e617f req-8a7f31b1-9de9-4254-837c-6c513de5da62 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updating instance_info_cache with network_info: [{"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[461d0d3c-bd55-4cf3-8180-84696333d552]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfc0fcf-b493-4ed7-b174-c8d0d866be8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0c419ec-a08a-4b99-8a01-e294ca3e617f req-8a7f31b1-9de9-4254-837c-6c513de5da62 service nova] Releasing lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:56:52 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:56:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c6355-99f9-4e92-b815-f40818600ba6]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG os_brick.utils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:56:52 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updating existing volume attachment record: 6a8c460d-b2e2-4be0-81f5-edd82a6cc33b {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:56:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:56:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-5781570e-c78e-4409-85e1-071d68c4fb37 req-1ee3d011-1861-4bd9-9dcd-f85e582e4c64 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received event network-changed-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-5781570e-c78e-4409-85e1-071d68c4fb37 req-1ee3d011-1861-4bd9-9dcd-f85e582e4c64 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Refreshing instance network info cache due to event network-changed-652c0af1-c29a-4917-afad-6f4f51211124. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5781570e-c78e-4409-85e1-071d68c4fb37 req-1ee3d011-1861-4bd9-9dcd-f85e582e4c64 service nova] Acquiring lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5781570e-c78e-4409-85e1-071d68c4fb37 req-1ee3d011-1861-4bd9-9dcd-f85e582e4c64 service nova] Acquired lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-5781570e-c78e-4409-85e1-071d68c4fb37 req-1ee3d011-1861-4bd9-9dcd-f85e582e4c64 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Refreshing network info cache for port 652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'flavor' on Instance uuid d98d2519-070b-4eca-ab05-be3bd1661c61 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:57:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Ignoring supplied device name: /dev/vdb
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:22 user nova-compute[75215]: INFO nova.compute.manager [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Attaching volume 704fe72a-b356-465d-a73a-3ffde2c804d6 to /dev/vdb
Nov 11 01:57:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-5781570e-c78e-4409-85e1-071d68c4fb37 req-1ee3d011-1861-4bd9-9dcd-f85e582e4c64 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Updated VIF entry in instance network info cache for port 652c0af1-c29a-4917-afad-6f4f51211124. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-5781570e-c78e-4409-85e1-071d68c4fb37 req-1ee3d011-1861-4bd9-9dcd-f85e582e4c64 service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Updating instance_info_cache with network_info: [{"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5781570e-c78e-4409-85e1-071d68c4fb37 req-1ee3d011-1861-4bd9-9dcd-f85e582e4c64 service nova] Releasing lock "refresh_cache-d98d2519-070b-4eca-ab05-be3bd1661c61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG os_brick.utils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd59ca8-dc96-4ed5-982d-14a2231645e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c84f0a-5ec7-4c9f-a33b-09c89db372ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6318ecb5-5e1a-458f-b187-815933a59433]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc4187-e93e-43b3-bcf2-4e7e0a082cad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:57:22 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:57:22 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[211eca77-3c53-4f21-a835-993da9329539]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG os_brick.utils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:57:22 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Updating existing volume attachment record: 7c066217-8c8f-47ee-8854-04afb497d3e3 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:57:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:25 user nova-compute[75215]: INFO nova.compute.manager [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Terminating instance
Nov 11 01:57:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-90842697-b833-483a-85fe-85cddc17d0d8 req-ede3b29c-2be0-4c07-a55b-fd16f5cf9c1c service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-unplugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90842697-b833-483a-85fe-85cddc17d0d8 req-ede3b29c-2be0-4c07-a55b-fd16f5cf9c1c service nova] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90842697-b833-483a-85fe-85cddc17d0d8 req-ede3b29c-2be0-4c07-a55b-fd16f5cf9c1c service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-90842697-b833-483a-85fe-85cddc17d0d8 req-ede3b29c-2be0-4c07-a55b-fd16f5cf9c1c service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-90842697-b833-483a-85fe-85cddc17d0d8 req-ede3b29c-2be0-4c07-a55b-fd16f5cf9c1c service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] No waiting events found dispatching network-vif-unplugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:57:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-90842697-b833-483a-85fe-85cddc17d0d8 req-ede3b29c-2be0-4c07-a55b-fd16f5cf9c1c service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-unplugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:57:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Instance destroyed successfully.
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'resources' on Instance uuid a48d0e4a-e786-43b9-aee9-20ba981b83fe {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1760529250',display_name='tempest-TestMinimumBasicScenario-server-1760529250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1760529250',id=35,image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMTJHla9hRHoawtbC1SkXIq8VVp2tsZeyfGz9fC9EJ34MdVWCZPTOBokWXOnzLWRmZpRJRcL+MXI4/4Hm+AQ19ex8lqXxCo/cyxyFYdIqsbwX0500h77p/fGNIRSaPYRw==',key_name='tempest-TestMinimumBasicScenario-1379367510',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-8555jnjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28182716-dd48-41ea-8267-0edd8e8cff59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:54:38Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=a48d0e4a-e786-43b9-aee9-20ba981b83fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "address": "fa:16:3e:25:2f:f5", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cf620-d5", "ovs_interfaceid": "a26cf620-d53e-48e5-93ba-5ad8393f82fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG os_vif [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa26cf620-d5, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=300156fd-1d3d-4814-bcdd-0a8d51edfde6) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:57:26 user nova-compute[75215]: INFO os_vif [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:2f:f5,bridge_name='br-int',has_traffic_filtering=True,id=a26cf620-d53e-48e5-93ba-5ad8393f82fb,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cf620-d5')
Nov 11 01:57:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Deleting instance files /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe_del
Nov 11 01:57:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Deletion of /opt/stack/data/nova/instances/a48d0e4a-e786-43b9-aee9-20ba981b83fe_del complete
Nov 11 01:57:26 user nova-compute[75215]: INFO nova.compute.manager [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 11 01:57:26 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:57:26 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Took 0.48 seconds to deallocate network for instance.
Nov 11 01:57:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:57:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:57:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:27 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Deleted allocations for instance a48d0e4a-e786-43b9-aee9-20ba981b83fe
Nov 11 01:57:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8f363880-2121-456d-b4c9-453f0edfda9d tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.876s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-c2f4d27f-a870-4dad-b1d3-931cffbc1f16 req-50b03414-36e5-408b-96f6-de389fe8996a service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:57:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c2f4d27f-a870-4dad-b1d3-931cffbc1f16 req-50b03414-36e5-408b-96f6-de389fe8996a service nova] Acquiring lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c2f4d27f-a870-4dad-b1d3-931cffbc1f16 req-50b03414-36e5-408b-96f6-de389fe8996a service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c2f4d27f-a870-4dad-b1d3-931cffbc1f16 req-50b03414-36e5-408b-96f6-de389fe8996a service nova] Lock "a48d0e4a-e786-43b9-aee9-20ba981b83fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-c2f4d27f-a870-4dad-b1d3-931cffbc1f16 req-50b03414-36e5-408b-96f6-de389fe8996a service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] No waiting events found dispatching network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:57:27 user nova-compute[75215]: WARNING nova.compute.manager [req-c2f4d27f-a870-4dad-b1d3-931cffbc1f16 req-50b03414-36e5-408b-96f6-de389fe8996a service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received unexpected event network-vif-plugged-a26cf620-d53e-48e5-93ba-5ad8393f82fb for instance with vm_state deleted and task_state None.
Nov 11 01:57:27 user nova-compute[75215]: DEBUG nova.compute.manager [req-c2f4d27f-a870-4dad-b1d3-931cffbc1f16 req-50b03414-36e5-408b-96f6-de389fe8996a service nova] [instance: a48d0e4a-e786-43b9-aee9-20ba981b83fe] Received event network-vif-deleted-a26cf620-d53e-48e5-93ba-5ad8393f82fb {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:57:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:57:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8429MB free_disk=25.158344268798828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:57:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d98d2519-070b-4eca-ab05-be3bd1661c61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:57:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:57:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 01:57:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:57:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:41 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "101432ed-bf0f-4086-9523-21a7bee1d9b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:57:44 user nova-compute[75215]: INFO nova.compute.claims [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Claim successful on node user
Nov 11 01:57:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:57:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:57:45 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:57:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG nova.policy [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '195d763c024c4db99be056d17d243171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5a366788b744f9b121b9e946ff230f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:57:45 user nova-compute[75215]: INFO nova.virt.block_device [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Booting with volume snapshot e8a945fd-f3f7-49a7-ad43-c0f63f9dc4d5 at /dev/vda
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjaOVFYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:57:45 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:57:45 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:57:45 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14059a9-9aea-42e4-9c8a-2937606840a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:57:45 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e95f76-2dbb-49a4-8d99-5906b5551914]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763] added
Nov 11 01:57:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[44558fe5-efa2-4233-ae7c-833e60acf528]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb6a87f-6752-42a8-89f5-40cfc19a4cd6]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjaOVFYQ {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjaOVFYQ" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d185da-74f1-4f08-bb97-972d36599141]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gjaOVFYQ'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a36e7d7-5862-4d04-8756-2f6b93d20093]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a5dde5-e538-4017-ae36-9cf9f4c3f2fc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 01:57:45 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 01:57:45 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:57:45 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 01:57:45 user nova-compute[75215]: 
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[142930da-6ce2-4707-963d-1bef659fab28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763, portal: 172.16.0.220,3260]
Nov 11 01:57:45 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763, portal: 172.16.0.220,3260] successful.
Nov 11 01:57:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[543414a8-8074-40e1-8059-ef41cd374fc2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[635fc94a-ddc9-4381-a6df-15e8890b7d96]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)
Nov 11 01:57:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)
Nov 11 01:57:45 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Successfully created port: 01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0493a-fb77-4afc-a578-f9a18a31550d]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:57:45 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjaOVFYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Successfully updated port: 01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "refresh_cache-101432ed-bf0f-4086-9523-21a7bee1d9b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquired lock "refresh_cache-101432ed-bf0f-4086-9523-21a7bee1d9b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ff5ed9a-c28a-4319-8013-e610d92b0076 req-d7d28bc3-31c2-4903-8c2f-aaf5254fc12f service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received event network-changed-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-7ff5ed9a-c28a-4319-8013-e610d92b0076 req-d7d28bc3-31c2-4903-8c2f-aaf5254fc12f service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Refreshing instance network info cache due to event network-changed-01956a0c-96d9-4e68-b7ae-86cb8499c4b9. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ff5ed9a-c28a-4319-8013-e610d92b0076 req-d7d28bc3-31c2-4903-8c2f-aaf5254fc12f service nova] Acquiring lock "refresh_cache-101432ed-bf0f-4086-9523-21a7bee1d9b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26439343539613538', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439343539613538', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG nova.objects.instance [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'flavor' on Instance uuid c9b03800-0532-446a-b985-1507e3b4db3e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:57:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:57:46 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:57:46 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:57:46 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:57:46 user nova-compute[75215]:   <serial>13c52bbe-4394-44b4-9850-d87a2f709763</serial>
Nov 11 01:57:46 user nova-compute[75215]: </disk>
Nov 11 01:57:46 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG nova.network.neutron [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Updating instance_info_cache with network_info: [{"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Releasing lock "refresh_cache-101432ed-bf0f-4086-9523-21a7bee1d9b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Instance network_info: |[{"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ff5ed9a-c28a-4319-8013-e610d92b0076 req-d7d28bc3-31c2-4903-8c2f-aaf5254fc12f service nova] Acquired lock "refresh_cache-101432ed-bf0f-4086-9523-21a7bee1d9b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ff5ed9a-c28a-4319-8013-e610d92b0076 req-d7d28bc3-31c2-4903-8c2f-aaf5254fc12f service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Refreshing network info cache for port 01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No VIF found with MAC fa:16:3e:c5:e7:0b, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ff5ed9a-c28a-4319-8013-e610d92b0076 req-d7d28bc3-31c2-4903-8c2f-aaf5254fc12f service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Updated VIF entry in instance network info cache for port 01956a0c-96d9-4e68-b7ae-86cb8499c4b9. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-7ff5ed9a-c28a-4319-8013-e610d92b0076 req-d7d28bc3-31c2-4903-8c2f-aaf5254fc12f service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Updating instance_info_cache with network_info: [{"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7ff5ed9a-c28a-4319-8013-e610d92b0076 req-d7d28bc3-31c2-4903-8c2f-aaf5254fc12f service nova] Releasing lock "refresh_cache-101432ed-bf0f-4086-9523-21a7bee1d9b0" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:57:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-35c51c8a-2853-4017-aad8-e1ead1509f8d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.667s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAXUmpev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:57:48 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:57:48 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:57:48 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5128fac3-8bab-4446-89b2-ddf901f3189b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:57:48 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3a592f-4a63-4818-b0c3-f04a092aec4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6] added
Nov 11 01:57:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bb90fa-f96b-4486-b84c-847c760df79d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cf10bb-9fc2-4b4b-8e86-039cf15555fb]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MAXUmpev {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MAXUmpev" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[178f9337-3214-450b-98ca-96d71ea138d5]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MAXUmpev'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acf6402-fa40-4eb8-b3d7-dc2d8191dbcf]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf5e0b7-1be4-4a46-8050-3405effe2da3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)
Nov 11 01:57:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)
Nov 11 01:57:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b068c1-f410-4cd2-b7a0-f53b59a5560e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6, portal: 172.16.0.220,3260]
Nov 11 01:57:48 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6, portal: 172.16.0.220,3260] successful.
Nov 11 01:57:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[120377ba-8848-4764-a454-92a8ab560f1b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37b9dea-b73c-45e3-ac12-8904f3f52844]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)
Nov 11 01:57:48 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:57:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)
Nov 11 01:57:48 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:57:48 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbae3d8d-3303-424e-913b-341c7464d36f]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:57:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAXUmpev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23865666532313231', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865666532313231', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG nova.objects.instance [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'flavor' on Instance uuid d98d2519-070b-4eca-ab05-be3bd1661c61 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 01:57:49 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:57:49 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:57:49 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:57:49 user nova-compute[75215]:   <serial>704fe72a-b356-465d-a73a-3ffde2c804d6</serial>
Nov 11 01:57:49 user nova-compute[75215]: </disk>
Nov 11 01:57:49 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:49 user nova-compute[75215]: INFO nova.compute.manager [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Detaching volume 13c52bbe-4394-44b4-9850-d87a2f709763
Nov 11 01:57:49 user nova-compute[75215]: INFO nova.virt.block_device [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Attempting to driver detach volume 13c52bbe-4394-44b4-9850-d87a2f709763 from mountpoint /dev/vdb
Nov 11 01:57:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Attempting to detach device vdb from instance c9b03800-0532-446a-b985-1507e3b4db3e from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:57:49 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:57:49 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:57:49 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:57:49 user nova-compute[75215]:   <serial>13c52bbe-4394-44b4-9850-d87a2f709763</serial>
Nov 11 01:57:49 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:57:49 user nova-compute[75215]: </disk>
Nov 11 01:57:49 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:57:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Successfully detached device vdb from instance c9b03800-0532-446a-b985-1507e3b4db3e from the persistent domain config.
Nov 11 01:57:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9b03800-0532-446a-b985-1507e3b4db3e from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:57:49 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:57:49 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 01:57:49 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:57:49 user nova-compute[75215]:   <serial>13c52bbe-4394-44b4-9850-d87a2f709763</serial>
Nov 11 01:57:49 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:57:49 user nova-compute[75215]: </disk>
Nov 11 01:57:49 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:57:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:57:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:57:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No VIF found with MAC fa:16:3e:1f:2b:10, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:57:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-a68f7780-becf-4bcb-8367-90eff919ff3f tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.621s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:50 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9b03800-0532-446a-b985-1507e3b4db3e {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:57:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG os_brick.utils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b15988c-adf7-4f97-917e-17fdfd6a22af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ac7a7a-36a0-4d8e-bb28-69086f2cf551]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5c762e-15bb-40f3-a20e-3efb2dff9312]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba8d15b-c866-44b3-98f0-2b5d58c21e76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 01:57:56 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 01:57:56 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d128ffd1-391e-43a4-b069-3a7cdb24926c]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG os_brick.utils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:57:56 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Updating existing volume attachment record: 519289c4-6896-4a5c-b6c3-5afade15c7ff {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 01:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:57 user nova-compute[75215]: INFO nova.compute.manager [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Terminating instance
Nov 11 01:57:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:57:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-19a930fc-36d3-4fd7-ae72-7c429b2ffba3 req-d1fe0b73-bed6-46f8-84cd-b1727e7282e0 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-unplugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19a930fc-36d3-4fd7-ae72-7c429b2ffba3 req-d1fe0b73-bed6-46f8-84cd-b1727e7282e0 service nova] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19a930fc-36d3-4fd7-ae72-7c429b2ffba3 req-d1fe0b73-bed6-46f8-84cd-b1727e7282e0 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19a930fc-36d3-4fd7-ae72-7c429b2ffba3 req-d1fe0b73-bed6-46f8-84cd-b1727e7282e0 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-19a930fc-36d3-4fd7-ae72-7c429b2ffba3 req-d1fe0b73-bed6-46f8-84cd-b1727e7282e0 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] No waiting events found dispatching network-vif-unplugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-19a930fc-36d3-4fd7-ae72-7c429b2ffba3 req-d1fe0b73-bed6-46f8-84cd-b1727e7282e0 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-unplugged-3cc562bf-7bac-40d7-b6ee-db41336f434b for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:57:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Instance destroyed successfully.
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.objects.instance [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'resources' on Instance uuid 2797cb1b-a56d-47c4-9810-4d5cd424c4e9 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752797510',display_name='tempest-ServerRescueNegativeTestJSON-server-1752797510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752797510',id=25,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-xrgv02un',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:43:05Z,user_data=None,user_id='2c11f7630148412285910f06eade4923',uuid=2797cb1b-a56d-47c4-9810-4d5cd424c4e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "address": "fa:16:3e:92:64:a6", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc562bf-7b", "ovs_interfaceid": "3cc562bf-7bac-40d7-b6ee-db41336f434b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:64:a6,bridge_name='br-int',has_traffic_filtering=True,id=3cc562bf-7bac-40d7-b6ee-db41336f434b,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc562bf-7b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG os_vif [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:64:a6,bridge_name='br-int',has_traffic_filtering=True,id=3cc562bf-7bac-40d7-b6ee-db41336f434b,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc562bf-7b') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cc562bf-7b, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d069f7d-774c-420b-bdd0-f679094537b6) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:57:58 user nova-compute[75215]: INFO os_vif [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:64:a6,bridge_name='br-int',has_traffic_filtering=True,id=3cc562bf-7bac-40d7-b6ee-db41336f434b,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc562bf-7b')
Nov 11 01:57:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Deleting instance files /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9_del
Nov 11 01:57:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Deletion of /opt/stack/data/nova/instances/2797cb1b-a56d-47c4-9810-4d5cd424c4e9_del complete
Nov 11 01:57:58 user nova-compute[75215]: INFO nova.compute.manager [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 11 01:57:58 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:57:58 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:57:59 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:57:59 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Took 0.70 seconds to deallocate network for instance.
Nov 11 01:57:59 user nova-compute[75215]: DEBUG nova.compute.manager [req-1c97edc5-e601-42d7-8377-f0aa12106871 req-c5fef8bf-2386-4ce0-8de7-7147e9478216 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-deleted-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:57:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:57:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:57:59 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:57:59 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:57:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:57:59 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Deleted allocations for instance 2797cb1b-a56d-47c4-9810-4d5cd424c4e9
Nov 11 01:57:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-7370337d-d446-4487-b39d-678d3f2c8044 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.084s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf6290d1-b7d8-4d18-9c10-17b500a99f4f req-0d9108f6-b4c2-4717-b65c-6a6e8b502e81 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf6290d1-b7d8-4d18-9c10-17b500a99f4f req-0d9108f6-b4c2-4717-b65c-6a6e8b502e81 service nova] Acquiring lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf6290d1-b7d8-4d18-9c10-17b500a99f4f req-0d9108f6-b4c2-4717-b65c-6a6e8b502e81 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bf6290d1-b7d8-4d18-9c10-17b500a99f4f req-0d9108f6-b4c2-4717-b65c-6a6e8b502e81 service nova] Lock "2797cb1b-a56d-47c4-9810-4d5cd424c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-bf6290d1-b7d8-4d18-9c10-17b500a99f4f req-0d9108f6-b4c2-4717-b65c-6a6e8b502e81 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] No waiting events found dispatching network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:58:00 user nova-compute[75215]: WARNING nova.compute.manager [req-bf6290d1-b7d8-4d18-9c10-17b500a99f4f req-0d9108f6-b4c2-4717-b65c-6a6e8b502e81 service nova] [instance: 2797cb1b-a56d-47c4-9810-4d5cd424c4e9] Received unexpected event network-vif-plugged-3cc562bf-7bac-40d7-b6ee-db41336f434b for instance with vm_state deleted and task_state None.
Nov 11 01:58:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:10 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9b03800-0532-446a-b985-1507e3b4db3e is timed out.
Nov 11 01:58:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Successfully detached device vdb from instance c9b03800-0532-446a-b985-1507e3b4db3e from the live domain config.
Nov 11 01:58:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjaOVFYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:58:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0bafc3-1d7c-4530-8753-6f11d2b23dc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:58:10 user nova-compute[75215]: No targets found.
Nov 11 01:58:10 user nova-compute[75215]: iSNS:
Nov 11 01:58:10 user nova-compute[75215]: No targets found.
Nov 11 01:58:10 user nova-compute[75215]: STATIC:
Nov 11 01:58:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6
Nov 11 01:58:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:58:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:58:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763
Nov 11 01:58:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:58:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:58:10 user nova-compute[75215]: FIRMWARE:
Nov 11 01:58:10 user nova-compute[75215]: No targets found.
Nov 11 01:58:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:58:10 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:58:10 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ec650-c863-45af-8311-5092081cb0db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[751e92ba-5486-4e7e-b935-e5e15880017c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)
Nov 11 01:58:10 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:58:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 (non-flash)
Nov 11 01:58:10 user nova-compute[75215]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:58:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40442a4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6871ab9-3bb6-4424-b6e7-721f86c61ea3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d4723-d58e-4cb6-8e40-622b5a83e897]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d46e1-feea-4184-8af0-21d122d8b9ce]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5be21-d88f-42ba-b770-c428cd305ced]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2b5258-ed68-48c4-9e1d-4d4cfefff492]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6778f56-6045-4d1a-bd66-4e78fa072f7d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763, portal: 172.16.0.220,3260]
Nov 11 01:58:10 user nova-compute[75215]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763, portal: 172.16.0.220,3260] successful.
Nov 11 01:58:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c52bbe-4394-44b4-9850-d87a2f709763 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3005b79-fed9-4155-835f-79141451a166]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] <== disconnect_volume: return (313ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:58:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:58:11 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'flavor' on Instance uuid c9b03800-0532-446a-b985-1507e3b4db3e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:58:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d1a7bdaf-d085-42f3-b12a-f0c237122ab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.035s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:58:19 user nova-compute[75215]: INFO nova.compute.claims [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Claim successful on node user
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:58:19 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.policy [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2b088eb7c0b47b2bc676cbc3f8a1b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bd80ef3ccb4c4e978990e15a2b0dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:58:19 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Creating image(s)
Nov 11 01:58:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "/opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "/opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "/opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.087s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "bb3466c6fb4ad7a10686dd6a372810e23f667852" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "bb3466c6fb4ad7a10686dd6a372810e23f667852" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Successfully created port: 8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG nova.virt.images [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] 9552c66b-73ee-458c-94e7-21dc56228115 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:58:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852.part /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852.part /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852.converted" returned: 0 in 0.305s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "bb3466c6fb4ad7a10686dd6a372810e23f667852" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.381s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Successfully updated port: 8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-e1792288-940b-4527-b745-ac8a016b6a79 req-54550e28-c7d4-457b-9f59-1af2e6a0de27 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG nova.compute.manager [req-e1792288-940b-4527-b745-ac8a016b6a79 req-54550e28-c7d4-457b-9f59-1af2e6a0de27 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing instance network info cache due to event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1792288-940b-4527-b745-ac8a016b6a79 req-54550e28-c7d4-457b-9f59-1af2e6a0de27 service nova] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852 --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "bb3466c6fb4ad7a10686dd6a372810e23f667852" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "bb3466c6fb4ad7a10686dd6a372810e23f667852" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852 --force-share --output=json" returned: 0 in 0.205s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852,backing_fmt=raw /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852,backing_fmt=raw /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk 1073741824" returned: 0 in 0.050s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "bb3466c6fb4ad7a10686dd6a372810e23f667852" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Instance network_info: |[{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1792288-940b-4527-b745-ac8a016b6a79 req-54550e28-c7d4-457b-9f59-1af2e6a0de27 service nova] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:58:21 user nova-compute[75215]: DEBUG nova.network.neutron [req-e1792288-940b-4527-b745-ac8a016b6a79 req-54550e28-c7d4-457b-9f59-1af2e6a0de27 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852 --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Cannot resize image /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Ensure instance console log exists: /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Start _get_guest_xml network_info=[{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:58:17Z,direct_url=<?>,disk_format='qcow2',id=9552c66b-73ee-458c-94e7-21dc56228115,min_disk=0,min_ram=0,name='tempest-scenario-img--824971092',owner='a7bd80ef3ccb4c4e978990e15a2b0dd3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:58:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '9552c66b-73ee-458c-94e7-21dc56228115'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:58:22 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:58:22 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:58:17Z,direct_url=<?>,disk_format='qcow2',id=9552c66b-73ee-458c-94e7-21dc56228115,min_disk=0,min_ram=0,name='tempest-scenario-img--824971092',owner='a7bd80ef3ccb4c4e978990e15a2b0dd3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:58:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1493995148',display_name='tempest-TestMinimumBasicScenario-server-1493995148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1493995148',id=42,image_ref='9552c66b-73ee-458c-94e7-21dc56228115',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2I93PGahE8CofaI5Lsfzy5vgbIgz8PtWk9gshxoT3nqZWg1N8+gNUrCSUGqmJAJTv6jDZbS/9eL1zXvnmuoelBvZaBaWyoJawuunLD68CBk0ji6KqtnpZYpZOEgzD78A==',key_name='tempest-TestMinimumBasicScenario-1745147391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-tdb6kjfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9552c66b-73ee-458c-94e7-21dc56228115',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:58:20Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=905d9e3a-da73-49a4-8548-81512b37fb86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=8bd632f6-8b87-4591-99d1-d40b8571210f,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd632f6-8b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'pci_devices' on Instance uuid 905d9e3a-da73-49a4-8548-81512b37fb86 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:58:22 user nova-compute[75215]:   <uuid>905d9e3a-da73-49a4-8548-81512b37fb86</uuid>
Nov 11 01:58:22 user nova-compute[75215]:   <name>instance-0000002a</name>
Nov 11 01:58:22 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:58:22 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:58:22 user nova-compute[75215]:   <metadata>
Nov 11 01:58:22 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:58:22 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:58:22 user nova-compute[75215]:       <nova:name>tempest-TestMinimumBasicScenario-server-1493995148</nova:name>
Nov 11 01:58:22 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:58:22</nova:creationTime>
Nov 11 01:58:22 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:58:22 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:58:22 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:58:22 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:58:22 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:58:22 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:58:22 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:58:22 user nova-compute[75215]:       <nova:owner>
Nov 11 01:58:22 user nova-compute[75215]:         <nova:user uuid="b2b088eb7c0b47b2bc676cbc3f8a1b4c">tempest-TestMinimumBasicScenario-1149206322-project-member</nova:user>
Nov 11 01:58:22 user nova-compute[75215]:         <nova:project uuid="a7bd80ef3ccb4c4e978990e15a2b0dd3">tempest-TestMinimumBasicScenario-1149206322</nova:project>
Nov 11 01:58:22 user nova-compute[75215]:       </nova:owner>
Nov 11 01:58:22 user nova-compute[75215]:       <nova:root type="image" uuid="9552c66b-73ee-458c-94e7-21dc56228115"/>
Nov 11 01:58:22 user nova-compute[75215]:       <nova:ports>
Nov 11 01:58:22 user nova-compute[75215]:         <nova:port uuid="8bd632f6-8b87-4591-99d1-d40b8571210f">
Nov 11 01:58:22 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 01:58:22 user nova-compute[75215]:         </nova:port>
Nov 11 01:58:22 user nova-compute[75215]:       </nova:ports>
Nov 11 01:58:22 user nova-compute[75215]:     </nova:instance>
Nov 11 01:58:22 user nova-compute[75215]:   </metadata>
Nov 11 01:58:22 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:58:22 user nova-compute[75215]:     <system>
Nov 11 01:58:22 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:58:22 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:58:22 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:58:22 user nova-compute[75215]:       <entry name="serial">905d9e3a-da73-49a4-8548-81512b37fb86</entry>
Nov 11 01:58:22 user nova-compute[75215]:       <entry name="uuid">905d9e3a-da73-49a4-8548-81512b37fb86</entry>
Nov 11 01:58:22 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:58:22 user nova-compute[75215]:     </system>
Nov 11 01:58:22 user nova-compute[75215]:   </sysinfo>
Nov 11 01:58:22 user nova-compute[75215]:   <os>
Nov 11 01:58:22 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:58:22 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:58:22 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:58:22 user nova-compute[75215]:   </os>
Nov 11 01:58:22 user nova-compute[75215]:   <features>
Nov 11 01:58:22 user nova-compute[75215]:     <acpi/>
Nov 11 01:58:22 user nova-compute[75215]:     <apic/>
Nov 11 01:58:22 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:58:22 user nova-compute[75215]:   </features>
Nov 11 01:58:22 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:58:22 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:58:22 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:58:22 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:58:22 user nova-compute[75215]:   </clock>
Nov 11 01:58:22 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:58:22 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:58:22 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:58:22 user nova-compute[75215]:   </cpu>
Nov 11 01:58:22 user nova-compute[75215]:   <devices>
Nov 11 01:58:22 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:58:22 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:58:22 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk"/>
Nov 11 01:58:22 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:58:22 user nova-compute[75215]:     </disk>
Nov 11 01:58:22 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:58:22 user nova-compute[75215]:       <mac address="fa:16:3e:cc:50:3a"/>
Nov 11 01:58:22 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:58:22 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:58:22 user nova-compute[75215]:       <target dev="tap8bd632f6-8b"/>
Nov 11 01:58:22 user nova-compute[75215]:     </interface>
Nov 11 01:58:22 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:58:22 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/console.log" append="off"/>
Nov 11 01:58:22 user nova-compute[75215]:     </serial>
Nov 11 01:58:22 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:58:22 user nova-compute[75215]:     <video>
Nov 11 01:58:22 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:58:22 user nova-compute[75215]:     </video>
Nov 11 01:58:22 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:58:22 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:58:22 user nova-compute[75215]:     </rng>
Nov 11 01:58:22 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:58:22 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:58:22 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:58:22 user nova-compute[75215]:     </memballoon>
Nov 11 01:58:22 user nova-compute[75215]:   </devices>
Nov 11 01:58:22 user nova-compute[75215]: </domain>
Nov 11 01:58:22 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1493995148',display_name='tempest-TestMinimumBasicScenario-server-1493995148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1493995148',id=42,image_ref='9552c66b-73ee-458c-94e7-21dc56228115',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2I93PGahE8CofaI5Lsfzy5vgbIgz8PtWk9gshxoT3nqZWg1N8+gNUrCSUGqmJAJTv6jDZbS/9eL1zXvnmuoelBvZaBaWyoJawuunLD68CBk0ji6KqtnpZYpZOEgzD78A==',key_name='tempest-TestMinimumBasicScenario-1745147391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-tdb6kjfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9552c66b-73ee-458c-94e7-21dc56228115',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:58:20Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=905d9e3a-da73-49a4-8548-81512b37fb86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=8bd632f6-8b87-4591-99d1-d40b8571210f,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd632f6-8b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG os_vif [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=8bd632f6-8b87-4591-99d1-d40b8571210f,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd632f6-8b') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '759e7bfe-b6a0-5ceb-a54a-1e77b7f59e5c', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bd632f6-8b, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bd632f6-8b, col_values=(('qos', UUID('53191f0a-7963-4833-b9ed-66e1e8e538a9')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bd632f6-8b, col_values=(('external_ids', {'iface-id': '8bd632f6-8b87-4591-99d1-d40b8571210f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:50:3a', 'vm-uuid': '905d9e3a-da73-49a4-8548-81512b37fb86'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:22 user nova-compute[75215]: INFO os_vif [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=8bd632f6-8b87-4591-99d1-d40b8571210f,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd632f6-8b')
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No VIF found with MAC fa:16:3e:cc:50:3a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-e1792288-940b-4527-b745-ac8a016b6a79 req-54550e28-c7d4-457b-9f59-1af2e6a0de27 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updated VIF entry in instance network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG nova.network.neutron [req-e1792288-940b-4527-b745-ac8a016b6a79 req-54550e28-c7d4-457b-9f59-1af2e6a0de27 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:58:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e1792288-940b-4527-b745-ac8a016b6a79 req-54550e28-c7d4-457b-9f59-1af2e6a0de27 service nova] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:58:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-bc210a17-0eaf-43bb-aa63-0a6d16b05f72 req-64b20906-bf5e-42ce-95d0-82803cd77624 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc210a17-0eaf-43bb-aa63-0a6d16b05f72 req-64b20906-bf5e-42ce-95d0-82803cd77624 service nova] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc210a17-0eaf-43bb-aa63-0a6d16b05f72 req-64b20906-bf5e-42ce-95d0-82803cd77624 service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:23 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bc210a17-0eaf-43bb-aa63-0a6d16b05f72 req-64b20906-bf5e-42ce-95d0-82803cd77624 service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:23 user nova-compute[75215]: DEBUG nova.compute.manager [req-bc210a17-0eaf-43bb-aa63-0a6d16b05f72 req-64b20906-bf5e-42ce-95d0-82803cd77624 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] No waiting events found dispatching network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:58:23 user nova-compute[75215]: WARNING nova.compute.manager [req-bc210a17-0eaf-43bb-aa63-0a6d16b05f72 req-64b20906-bf5e-42ce-95d0-82803cd77624 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received unexpected event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f for instance with vm_state building and task_state spawning.
Nov 11 01:58:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:58:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Instance spawned successfully.
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:25 user nova-compute[75215]: INFO nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 11 01:58:26 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:58:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-998c0135-1150-4dee-86d6-6e8526ea5dd4 req-2ef20c1c-cd95-4ada-b8b7-9681bb02d669 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-998c0135-1150-4dee-86d6-6e8526ea5dd4 req-2ef20c1c-cd95-4ada-b8b7-9681bb02d669 service nova] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-998c0135-1150-4dee-86d6-6e8526ea5dd4 req-2ef20c1c-cd95-4ada-b8b7-9681bb02d669 service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-998c0135-1150-4dee-86d6-6e8526ea5dd4 req-2ef20c1c-cd95-4ada-b8b7-9681bb02d669 service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-998c0135-1150-4dee-86d6-6e8526ea5dd4 req-2ef20c1c-cd95-4ada-b8b7-9681bb02d669 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] No waiting events found dispatching network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:58:26 user nova-compute[75215]: WARNING nova.compute.manager [req-998c0135-1150-4dee-86d6-6e8526ea5dd4 req-2ef20c1c-cd95-4ada-b8b7-9681bb02d669 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received unexpected event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f for instance with vm_state building and task_state spawning.
Nov 11 01:58:26 user nova-compute[75215]: INFO nova.compute.manager [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Took 6.71 seconds to build instance.
Nov 11 01:58:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f289621b-bf04-4bd4-af85-faa3d09323fe tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.829s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:28 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:28 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:58:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:58:30 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:58:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8452MB free_disk=25.15250015258789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d98d2519-070b-4eca-ab05-be3bd1661c61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 101432ed-bf0f-4086-9523-21a7bee1d9b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 905d9e3a-da73-49a4-8548-81512b37fb86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:58:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:58:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:58:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:58:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:58:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Skipping network cache update for instance because it is Building. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [{"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-6bd67e17-1262-4cf5-83cf-5de6852e5d7e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:58:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Creating image(s)
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Ensure instance console log exists: /opt/stack/data/nova/instances/101432ed-bf0f-4086-9523-21a7bee1d9b0/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Start _get_guest_xml network_info=[{"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '519289c4-6896-4a5c-b6c3-5afade15c7ff', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUSGyczF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '101432ed-bf0f-4086-9523-21a7bee1d9b0', 'attached_at': '', 'detached_at': '', 'volume_id': '354140a4-65b9-4fd0-8353-f190c4757594', 'serial': '354140a4-65b9-4fd0-8353-f190c4757594'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:58:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:58:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUSGyczF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:58:39 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:58:39 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:58:39 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e962eb5d-56bb-4333-b545-ad19613a44c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 01:58:39 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c52d0fb-1825-419b-bfd4-5cb821d44e42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594] added
Nov 11 01:58:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.062s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0ee695-d4f5-403a-af93-8fee3c650a23]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b017fa-d7d1-4fad-83d2-fc899ccbb3aa]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUSGyczF {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aUSGyczF" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c427de-11ff-4051-ac05-b58ff1298ab7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aUSGyczF'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee52248-f076-451d-98bc-893d350e8f26]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc6c41-0e5c-42dd-b715-a62d3f308bd8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:58:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:58:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9775d18a-180c-4e5a-b027-04830ca13565]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594, portal: 172.16.0.220,3260]
Nov 11 01:58:39 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594, portal: 172.16.0.220,3260] successful.
Nov 11 01:58:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[91acad9a-fec4-4780-8bbc-ef091b6f1970]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[73019e6b-b12e-440b-b28c-58cb6dae2b26]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:58:39 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)
Nov 11 01:58:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:58:39 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)
Nov 11 01:58:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d5305d-ebf2-4126-8faf-bf52d2bf2938]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:58:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUSGyczF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23939303764646438', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939303764646438', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-41185756',display_name='tempest-TestVolumeBootPattern-server-41185756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-41185756',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-uzwqx1kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:57:45Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=101432ed-bf0f-4086-9523-21a7bee1d9b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=01956a0c-96d9-4e68-b7ae-86cb8499c4b9,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01956a0c-96') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.objects.instance [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'pci_devices' on Instance uuid 101432ed-bf0f-4086-9523-21a7bee1d9b0 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:58:40 user nova-compute[75215]:   <uuid>101432ed-bf0f-4086-9523-21a7bee1d9b0</uuid>
Nov 11 01:58:40 user nova-compute[75215]:   <name>instance-00000029</name>
Nov 11 01:58:40 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:58:40 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:58:40 user nova-compute[75215]:   <metadata>
Nov 11 01:58:40 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:58:40 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:58:40 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-server-41185756</nova:name>
Nov 11 01:58:40 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:58:39</nova:creationTime>
Nov 11 01:58:40 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:58:40 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:58:40 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:58:40 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:58:40 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:58:40 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:58:40 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:58:40 user nova-compute[75215]:       <nova:owner>
Nov 11 01:58:40 user nova-compute[75215]:         <nova:user uuid="195d763c024c4db99be056d17d243171">tempest-TestVolumeBootPattern-1487726842-project-member</nova:user>
Nov 11 01:58:40 user nova-compute[75215]:         <nova:project uuid="ca5a366788b744f9b121b9e946ff230f">tempest-TestVolumeBootPattern-1487726842</nova:project>
Nov 11 01:58:40 user nova-compute[75215]:       </nova:owner>
Nov 11 01:58:40 user nova-compute[75215]:       <nova:ports>
Nov 11 01:58:40 user nova-compute[75215]:         <nova:port uuid="01956a0c-96d9-4e68-b7ae-86cb8499c4b9">
Nov 11 01:58:40 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 01:58:40 user nova-compute[75215]:         </nova:port>
Nov 11 01:58:40 user nova-compute[75215]:       </nova:ports>
Nov 11 01:58:40 user nova-compute[75215]:     </nova:instance>
Nov 11 01:58:40 user nova-compute[75215]:   </metadata>
Nov 11 01:58:40 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:58:40 user nova-compute[75215]:     <system>
Nov 11 01:58:40 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:58:40 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:58:40 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:58:40 user nova-compute[75215]:       <entry name="serial">101432ed-bf0f-4086-9523-21a7bee1d9b0</entry>
Nov 11 01:58:40 user nova-compute[75215]:       <entry name="uuid">101432ed-bf0f-4086-9523-21a7bee1d9b0</entry>
Nov 11 01:58:40 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:58:40 user nova-compute[75215]:     </system>
Nov 11 01:58:40 user nova-compute[75215]:   </sysinfo>
Nov 11 01:58:40 user nova-compute[75215]:   <os>
Nov 11 01:58:40 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:58:40 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:58:40 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:58:40 user nova-compute[75215]:   </os>
Nov 11 01:58:40 user nova-compute[75215]:   <features>
Nov 11 01:58:40 user nova-compute[75215]:     <acpi/>
Nov 11 01:58:40 user nova-compute[75215]:     <apic/>
Nov 11 01:58:40 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:58:40 user nova-compute[75215]:   </features>
Nov 11 01:58:40 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:58:40 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:58:40 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:58:40 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:58:40 user nova-compute[75215]:   </clock>
Nov 11 01:58:40 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:58:40 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:58:40 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:58:40 user nova-compute[75215]:   </cpu>
Nov 11 01:58:40 user nova-compute[75215]:   <devices>
Nov 11 01:58:40 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 01:58:40 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:58:40 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 11 01:58:40 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:58:40 user nova-compute[75215]:       <serial>354140a4-65b9-4fd0-8353-f190c4757594</serial>
Nov 11 01:58:40 user nova-compute[75215]:     </disk>
Nov 11 01:58:40 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:58:40 user nova-compute[75215]:       <mac address="fa:16:3e:55:3d:ed"/>
Nov 11 01:58:40 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:58:40 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:58:40 user nova-compute[75215]:       <target dev="tap01956a0c-96"/>
Nov 11 01:58:40 user nova-compute[75215]:     </interface>
Nov 11 01:58:40 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:58:40 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/101432ed-bf0f-4086-9523-21a7bee1d9b0/console.log" append="off"/>
Nov 11 01:58:40 user nova-compute[75215]:     </serial>
Nov 11 01:58:40 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:58:40 user nova-compute[75215]:     <video>
Nov 11 01:58:40 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:58:40 user nova-compute[75215]:     </video>
Nov 11 01:58:40 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:58:40 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:58:40 user nova-compute[75215]:     </rng>
Nov 11 01:58:40 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:58:40 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:58:40 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:58:40 user nova-compute[75215]:     </memballoon>
Nov 11 01:58:40 user nova-compute[75215]:   </devices>
Nov 11 01:58:40 user nova-compute[75215]: </domain>
Nov 11 01:58:40 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-41185756',display_name='tempest-TestVolumeBootPattern-server-41185756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-41185756',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-uzwqx1kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:57:45Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=101432ed-bf0f-4086-9523-21a7bee1d9b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=01956a0c-96d9-4e68-b7ae-86cb8499c4b9,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01956a0c-96') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG os_vif [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=01956a0c-96d9-4e68-b7ae-86cb8499c4b9,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01956a0c-96') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e020f1b-07f0-5d01-9eaf-eddff07c37b5', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01956a0c-96, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01956a0c-96, col_values=(('qos', UUID('5cdfa5df-204e-4f8b-8f6a-e676de47ec61')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01956a0c-96, col_values=(('external_ids', {'iface-id': '01956a0c-96d9-4e68-b7ae-86cb8499c4b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:3d:ed', 'vm-uuid': '101432ed-bf0f-4086-9523-21a7bee1d9b0'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:40 user nova-compute[75215]: INFO os_vif [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=01956a0c-96d9-4e68-b7ae-86cb8499c4b9,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01956a0c-96')
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:58:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No VIF found with MAC fa:16:3e:55:3d:ed, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-546dede6-67ef-4804-becc-743db79c933b req-7c6c3db6-33d4-4131-9aaa-7931afa3b6cf service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received event network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-546dede6-67ef-4804-becc-743db79c933b req-7c6c3db6-33d4-4131-9aaa-7931afa3b6cf service nova] Acquiring lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-546dede6-67ef-4804-becc-743db79c933b req-7c6c3db6-33d4-4131-9aaa-7931afa3b6cf service nova] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-546dede6-67ef-4804-becc-743db79c933b req-7c6c3db6-33d4-4131-9aaa-7931afa3b6cf service nova] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-546dede6-67ef-4804-becc-743db79c933b req-7c6c3db6-33d4-4131-9aaa-7931afa3b6cf service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] No waiting events found dispatching network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:58:42 user nova-compute[75215]: WARNING nova.compute.manager [req-546dede6-67ef-4804-becc-743db79c933b req-7c6c3db6-33d4-4131-9aaa-7931afa3b6cf service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received unexpected event network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 for instance with vm_state building and task_state spawning.
Nov 11 01:58:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:58:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Instance spawned successfully.
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:58:44 user nova-compute[75215]: INFO nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-00d2b96b-0bf6-4c2f-9d54-2ed805a4f707 req-4f66c5d5-993d-4998-9453-c028ca6f7cb9 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received event network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00d2b96b-0bf6-4c2f-9d54-2ed805a4f707 req-4f66c5d5-993d-4998-9453-c028ca6f7cb9 service nova] Acquiring lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00d2b96b-0bf6-4c2f-9d54-2ed805a4f707 req-4f66c5d5-993d-4998-9453-c028ca6f7cb9 service nova] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-00d2b96b-0bf6-4c2f-9d54-2ed805a4f707 req-4f66c5d5-993d-4998-9453-c028ca6f7cb9 service nova] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-00d2b96b-0bf6-4c2f-9d54-2ed805a4f707 req-4f66c5d5-993d-4998-9453-c028ca6f7cb9 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] No waiting events found dispatching network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:58:44 user nova-compute[75215]: WARNING nova.compute.manager [req-00d2b96b-0bf6-4c2f-9d54-2ed805a4f707 req-4f66c5d5-993d-4998-9453-c028ca6f7cb9 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received unexpected event network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 for instance with vm_state building and task_state spawning.
Nov 11 01:58:44 user nova-compute[75215]: INFO nova.compute.manager [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Took 60.21 seconds to build instance.
Nov 11 01:58:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-b9dda2c1-7761-41c4-bd56-44f37af90b54 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.322s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:48 user nova-compute[75215]: INFO nova.compute.manager [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Terminating instance
Nov 11 01:58:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ddd252a-db73-4e05-9d57-5318de2633e2 req-c71f93fb-7d55-42ee-a260-26c73af88dbc service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ddd252a-db73-4e05-9d57-5318de2633e2 req-c71f93fb-7d55-42ee-a260-26c73af88dbc service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ddd252a-db73-4e05-9d57-5318de2633e2 req-c71f93fb-7d55-42ee-a260-26c73af88dbc service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3ddd252a-db73-4e05-9d57-5318de2633e2 req-c71f93fb-7d55-42ee-a260-26c73af88dbc service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ddd252a-db73-4e05-9d57-5318de2633e2 req-c71f93fb-7d55-42ee-a260-26c73af88dbc service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:58:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-3ddd252a-db73-4e05-9d57-5318de2633e2 req-c71f93fb-7d55-42ee-a260-26c73af88dbc service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-unplugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:58:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Instance destroyed successfully.
Nov 11 01:58:49 user nova-compute[75215]: DEBUG nova.objects.instance [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lazy-loading 'resources' on Instance uuid 6bd67e17-1262-4cf5-83cf-5de6852e5d7e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1868885677',display_name='tempest-ServerRescueNegativeTestJSON-server-1868885677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1868885677',id=24,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dddded455ac3456e9316603170bb6fea',ramdisk_id='',reservation_id='r-6hfs45g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-107483545',owner_user_name='tempest-ServerRescueNegativeTestJSON-107483545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:47:52Z,user_data=None,user_id='2c11f7630148412285910f06eade4923',uuid=6bd67e17-1262-4cf5-83cf-5de6852e5d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converting VIF {"id": "5108ba03-5c01-43b3-b46d-9ed376611b44", "address": "fa:16:3e:21:e6:b0", "network": {"id": "4abbaac6-c9eb-4fba-85dc-b5ef6538ca41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-758286682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dddded455ac3456e9316603170bb6fea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5108ba03-5c", "ovs_interfaceid": "5108ba03-5c01-43b3-b46d-9ed376611b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:e6:b0,bridge_name='br-int',has_traffic_filtering=True,id=5108ba03-5c01-43b3-b46d-9ed376611b44,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5108ba03-5c') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG os_vif [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:e6:b0,bridge_name='br-int',has_traffic_filtering=True,id=5108ba03-5c01-43b3-b46d-9ed376611b44,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5108ba03-5c') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5108ba03-5c, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c32cc0bb-b202-4d88-bf66-d8d0960ef3a4) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:58:49 user nova-compute[75215]: INFO os_vif [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:e6:b0,bridge_name='br-int',has_traffic_filtering=True,id=5108ba03-5c01-43b3-b46d-9ed376611b44,network=Network(4abbaac6-c9eb-4fba-85dc-b5ef6538ca41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5108ba03-5c')
Nov 11 01:58:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Deleting instance files /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e_del
Nov 11 01:58:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Deletion of /opt/stack/data/nova/instances/6bd67e17-1262-4cf5-83cf-5de6852e5d7e_del complete
Nov 11 01:58:49 user nova-compute[75215]: INFO nova.compute.manager [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 11 01:58:49 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:58:49 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Took 0.62 seconds to deallocate network for instance.
Nov 11 01:58:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-949b507f-6041-4252-bdb4-5123ea8b3276 req-86cde9c6-c70c-441b-a336-2f224ccb11ac service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-deleted-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:50 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Deleted allocations for instance 6bd67e17-1262-4cf5-83cf-5de6852e5d7e
Nov 11 01:58:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-e1f92bf0-d405-4c7a-994e-e8cc39ce66a1 tempest-ServerRescueNegativeTestJSON-107483545 tempest-ServerRescueNegativeTestJSON-107483545-project-member] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.157s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-e427b073-136b-4aee-a97e-23dd2d7e4ad3 req-2399a48b-b621-4a63-aed1-75383493ec4d service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427b073-136b-4aee-a97e-23dd2d7e4ad3 req-2399a48b-b621-4a63-aed1-75383493ec4d service nova] Acquiring lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427b073-136b-4aee-a97e-23dd2d7e4ad3 req-2399a48b-b621-4a63-aed1-75383493ec4d service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e427b073-136b-4aee-a97e-23dd2d7e4ad3 req-2399a48b-b621-4a63-aed1-75383493ec4d service nova] Lock "6bd67e17-1262-4cf5-83cf-5de6852e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:58:50 user nova-compute[75215]: DEBUG nova.compute.manager [req-e427b073-136b-4aee-a97e-23dd2d7e4ad3 req-2399a48b-b621-4a63-aed1-75383493ec4d service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] No waiting events found dispatching network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:58:50 user nova-compute[75215]: WARNING nova.compute.manager [req-e427b073-136b-4aee-a97e-23dd2d7e4ad3 req-2399a48b-b621-4a63-aed1-75383493ec4d service nova] [instance: 6bd67e17-1262-4cf5-83cf-5de6852e5d7e] Received unexpected event network-vif-plugged-5108ba03-5c01-43b3-b46d-9ed376611b44 for instance with vm_state deleted and task_state None.
Nov 11 01:58:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:58:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:59:06 user nova-compute[75215]: INFO nova.compute.manager [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] instance snapshotting
Nov 11 01:59:06 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Beginning live snapshot process
Nov 11 01:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json -f qcow2" returned: 0 in 0.222s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:06 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json -f qcow2 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json -f qcow2" returned: 0 in 0.250s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.218s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprkw05pgp/659ff3f96fd046dca34b3e742328aec6.delta 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprkw05pgp/659ff3f96fd046dca34b3e742328aec6.delta 1073741824" returned: 0 in 0.061s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:07 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 11 01:59:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 01:59:08 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75215) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 01:59:08 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 01:59:08 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:59:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprkw05pgp/659ff3f96fd046dca34b3e742328aec6.delta /opt/stack/data/nova/instances/snapshots/tmprkw05pgp/659ff3f96fd046dca34b3e742328aec6 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:09 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprkw05pgp/659ff3f96fd046dca34b3e742328aec6.delta /opt/stack/data/nova/instances/snapshots/tmprkw05pgp/659ff3f96fd046dca34b3e742328aec6" returned: 0 in 0.682s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Snapshot extracted, beginning image upload
Nov 11 01:59:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:12 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Snapshot image upload complete
Nov 11 01:59:12 user nova-compute[75215]: INFO nova.compute.manager [None req-cc37f68a-aa0c-4a4d-a265-58f33663f297 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Took 6.47 seconds to snapshot the instance on the hypervisor.
Nov 11 01:59:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:59:15 user nova-compute[75215]: INFO nova.compute.claims [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Claim successful on node user
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:59:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:59:15 user nova-compute[75215]: DEBUG nova.policy [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a486927bdc474540820f23ffb8758d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe9e1a46ae4d54973aad68cd3e0816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:59:16 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:59:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:59:16 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Creating image(s)
Nov 11 01:59:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "/opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "/opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "a96d091fe01647bd791465498db9070338bb1ab7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "a96d091fe01647bd791465498db9070338bb1ab7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7.part --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:16 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Successfully created port: e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7.part --force-share --output=json" returned: 0 in 0.210s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG nova.virt.images [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] 4e214719-247b-43b7-8ada-1ed3c6f38a44 was qcow2, converting to raw {{(pid=75215) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG nova.privsep.utils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75215) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7.part /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7.converted {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7.part /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7.converted" returned: 0 in 0.328s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7.converted --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "a96d091fe01647bd791465498db9070338bb1ab7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.671s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Successfully updated port: e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquired lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7 --force-share --output=json" returned: 0 in 0.221s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "a96d091fe01647bd791465498db9070338bb1ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "a96d091fe01647bd791465498db9070338bb1ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-be01dc27-4914-4489-ba39-897c55eaa76e req-35e3ecca-1cd7-4bc7-b1f8-e2d60918ea57 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-changed-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG nova.compute.manager [req-be01dc27-4914-4489-ba39-897c55eaa76e req-35e3ecca-1cd7-4bc7-b1f8-e2d60918ea57 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Refreshing instance network info cache due to event network-changed-e911ca15-640f-43a1-8ba7-6ea574c12db2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:59:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-be01dc27-4914-4489-ba39-897c55eaa76e req-35e3ecca-1cd7-4bc7-b1f8-e2d60918ea57 service nova] Acquiring lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7 --force-share --output=json" returned: 0 in 0.246s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7,backing_fmt=raw /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7,backing_fmt=raw /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk 1073741824" returned: 0 in 0.064s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "a96d091fe01647bd791465498db9070338bb1ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updating instance_info_cache with network_info: [{"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Releasing lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Instance network_info: |[{"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-be01dc27-4914-4489-ba39-897c55eaa76e req-35e3ecca-1cd7-4bc7-b1f8-e2d60918ea57 service nova] Acquired lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-be01dc27-4914-4489-ba39-897c55eaa76e req-35e3ecca-1cd7-4bc7-b1f8-e2d60918ea57 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Refreshing network info cache for port e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7 --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Ensure instance console log exists: /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Start _get_guest_xml network_info=[{"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='689d3f23894756395aa51ae050407c65',container_format='bare',created_at=2023-11-11T01:59:06Z,direct_url=<?>,disk_format='qcow2',id=4e214719-247b-43b7-8ada-1ed3c6f38a44,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-463972101',owner='a6fe9e1a46ae4d54973aad68cd3e0816',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T01:59:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '4e214719-247b-43b7-8ada-1ed3c6f38a44'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:59:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:59:18 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='689d3f23894756395aa51ae050407c65',container_format='bare',created_at=2023-11-11T01:59:06Z,direct_url=<?>,disk_format='qcow2',id=4e214719-247b-43b7-8ada-1ed3c6f38a44,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-463972101',owner='a6fe9e1a46ae4d54973aad68cd3e0816',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T01:59:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-510078255',display_name='tempest-TestStampPattern-server-510078255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-510078255',id=43,image_ref='4e214719-247b-43b7-8ada-1ed3c6f38a44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcw1WLcxHGrUZgRTLCyIgVsmMR4VUkGy9pjePScYuTXptsl6Clt/SyEY1h7Lk3D1TqiG4jkLE2ejH3fjVoqyLMcQCmiWHmrdAKLKNMXdQfBFqk3/YOam91kBTpZJVrp1Q==',key_name='tempest-TestStampPattern-1661226900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fe9e1a46ae4d54973aad68cd3e0816',ramdisk_id='',reservation_id='r-c6dcf59f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9b03800-0532-446a-b985-1507e3b4db3e',image_min_disk='1',image_min_ram='0',image_owner_id='a6fe9e1a46ae4d54973aad68cd3e0816',image_owner_project_name='tempest-TestStampPattern-1920847764',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1920847764-project-member',image_user_id='a486927bdc474540820f23ffb8758d45',network_allocated='True',owner_project_name='tempest-TestStampPattern-1920847764',owner_user_name='tempest-TestStampPattern-1920847764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:59:16Z,user_data=None,user_id='a486927bdc474540820f23ffb8758d45',uuid=0cfc863d-7a90-4cc7-8127-206b85037b16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converting VIF {"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:81:f8,bridge_name='br-int',has_traffic_filtering=True,id=e911ca15-640f-43a1-8ba7-6ea574c12db2,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape911ca15-64') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.objects.instance [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cfc863d-7a90-4cc7-8127-206b85037b16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:59:18 user nova-compute[75215]:   <uuid>0cfc863d-7a90-4cc7-8127-206b85037b16</uuid>
Nov 11 01:59:18 user nova-compute[75215]:   <name>instance-0000002b</name>
Nov 11 01:59:18 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:59:18 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:59:18 user nova-compute[75215]:   <metadata>
Nov 11 01:59:18 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:59:18 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:59:18 user nova-compute[75215]:       <nova:name>tempest-TestStampPattern-server-510078255</nova:name>
Nov 11 01:59:18 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:59:18</nova:creationTime>
Nov 11 01:59:18 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:59:18 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:59:18 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:59:18 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:59:18 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:59:18 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:59:18 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:59:18 user nova-compute[75215]:       <nova:owner>
Nov 11 01:59:18 user nova-compute[75215]:         <nova:user uuid="a486927bdc474540820f23ffb8758d45">tempest-TestStampPattern-1920847764-project-member</nova:user>
Nov 11 01:59:18 user nova-compute[75215]:         <nova:project uuid="a6fe9e1a46ae4d54973aad68cd3e0816">tempest-TestStampPattern-1920847764</nova:project>
Nov 11 01:59:18 user nova-compute[75215]:       </nova:owner>
Nov 11 01:59:18 user nova-compute[75215]:       <nova:root type="image" uuid="4e214719-247b-43b7-8ada-1ed3c6f38a44"/>
Nov 11 01:59:18 user nova-compute[75215]:       <nova:ports>
Nov 11 01:59:18 user nova-compute[75215]:         <nova:port uuid="e911ca15-640f-43a1-8ba7-6ea574c12db2">
Nov 11 01:59:18 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 01:59:18 user nova-compute[75215]:         </nova:port>
Nov 11 01:59:18 user nova-compute[75215]:       </nova:ports>
Nov 11 01:59:18 user nova-compute[75215]:     </nova:instance>
Nov 11 01:59:18 user nova-compute[75215]:   </metadata>
Nov 11 01:59:18 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:59:18 user nova-compute[75215]:     <system>
Nov 11 01:59:18 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:59:18 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:59:18 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:59:18 user nova-compute[75215]:       <entry name="serial">0cfc863d-7a90-4cc7-8127-206b85037b16</entry>
Nov 11 01:59:18 user nova-compute[75215]:       <entry name="uuid">0cfc863d-7a90-4cc7-8127-206b85037b16</entry>
Nov 11 01:59:18 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:59:18 user nova-compute[75215]:     </system>
Nov 11 01:59:18 user nova-compute[75215]:   </sysinfo>
Nov 11 01:59:18 user nova-compute[75215]:   <os>
Nov 11 01:59:18 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:59:18 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:59:18 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:59:18 user nova-compute[75215]:   </os>
Nov 11 01:59:18 user nova-compute[75215]:   <features>
Nov 11 01:59:18 user nova-compute[75215]:     <acpi/>
Nov 11 01:59:18 user nova-compute[75215]:     <apic/>
Nov 11 01:59:18 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:59:18 user nova-compute[75215]:   </features>
Nov 11 01:59:18 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:59:18 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:59:18 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:59:18 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:59:18 user nova-compute[75215]:   </clock>
Nov 11 01:59:18 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:59:18 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:59:18 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:59:18 user nova-compute[75215]:   </cpu>
Nov 11 01:59:18 user nova-compute[75215]:   <devices>
Nov 11 01:59:18 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:59:18 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:59:18 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk"/>
Nov 11 01:59:18 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:59:18 user nova-compute[75215]:     </disk>
Nov 11 01:59:18 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:59:18 user nova-compute[75215]:       <mac address="fa:16:3e:09:81:f8"/>
Nov 11 01:59:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:59:18 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:59:18 user nova-compute[75215]:       <target dev="tape911ca15-64"/>
Nov 11 01:59:18 user nova-compute[75215]:     </interface>
Nov 11 01:59:18 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:59:18 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/console.log" append="off"/>
Nov 11 01:59:18 user nova-compute[75215]:     </serial>
Nov 11 01:59:18 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:59:18 user nova-compute[75215]:     <video>
Nov 11 01:59:18 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:59:18 user nova-compute[75215]:     </video>
Nov 11 01:59:18 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:59:18 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:59:18 user nova-compute[75215]:     </rng>
Nov 11 01:59:18 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:59:18 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:59:18 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:59:18 user nova-compute[75215]:     </memballoon>
Nov 11 01:59:18 user nova-compute[75215]:   </devices>
Nov 11 01:59:18 user nova-compute[75215]: </domain>
Nov 11 01:59:18 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-510078255',display_name='tempest-TestStampPattern-server-510078255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-510078255',id=43,image_ref='4e214719-247b-43b7-8ada-1ed3c6f38a44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcw1WLcxHGrUZgRTLCyIgVsmMR4VUkGy9pjePScYuTXptsl6Clt/SyEY1h7Lk3D1TqiG4jkLE2ejH3fjVoqyLMcQCmiWHmrdAKLKNMXdQfBFqk3/YOam91kBTpZJVrp1Q==',key_name='tempest-TestStampPattern-1661226900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fe9e1a46ae4d54973aad68cd3e0816',ramdisk_id='',reservation_id='r-c6dcf59f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9b03800-0532-446a-b985-1507e3b4db3e',image_min_disk='1',image_min_ram='0',image_owner_id='a6fe9e1a46ae4d54973aad68cd3e0816',image_owner_project_name='tempest-TestStampPattern-1920847764',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1920847764-project-member',image_user_id='a486927bdc474540820f23ffb8758d45',network_allocated='True',owner_project_name='tempest-TestStampPattern-1920847764',owner_user_name='tempest-TestStampPattern-1920847764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:59:16Z,user_data=None,user_id='a486927bdc474540820f23ffb8758d45',uuid=0cfc863d-7a90-4cc7-8127-206b85037b16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converting VIF {"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:81:f8,bridge_name='br-int',has_traffic_filtering=True,id=e911ca15-640f-43a1-8ba7-6ea574c12db2,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape911ca15-64') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG os_vif [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:81:f8,bridge_name='br-int',has_traffic_filtering=True,id=e911ca15-640f-43a1-8ba7-6ea574c12db2,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape911ca15-64') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ed1807f-f99d-578a-995a-fbc4fa54f2ce', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape911ca15-64, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape911ca15-64, col_values=(('qos', UUID('b5b99240-0f94-4250-b656-d11db8ccab19')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape911ca15-64, col_values=(('external_ids', {'iface-id': 'e911ca15-640f-43a1-8ba7-6ea574c12db2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:81:f8', 'vm-uuid': '0cfc863d-7a90-4cc7-8127-206b85037b16'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:18 user nova-compute[75215]: INFO os_vif [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:81:f8,bridge_name='br-int',has_traffic_filtering=True,id=e911ca15-640f-43a1-8ba7-6ea574c12db2,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape911ca15-64')
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No VIF found with MAC fa:16:3e:09:81:f8, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-be01dc27-4914-4489-ba39-897c55eaa76e req-35e3ecca-1cd7-4bc7-b1f8-e2d60918ea57 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updated VIF entry in instance network info cache for port e911ca15-640f-43a1-8ba7-6ea574c12db2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG nova.network.neutron [req-be01dc27-4914-4489-ba39-897c55eaa76e req-35e3ecca-1cd7-4bc7-b1f8-e2d60918ea57 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updating instance_info_cache with network_info: [{"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:59:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-be01dc27-4914-4489-ba39-897c55eaa76e req-35e3ecca-1cd7-4bc7-b1f8-e2d60918ea57 service nova] Releasing lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:59:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0556c1d-e92c-48af-98f3-67f98c29a0e0 req-f7d6e1de-3a97-41b6-98e3-2540a451bfa1 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0556c1d-e92c-48af-98f3-67f98c29a0e0 req-f7d6e1de-3a97-41b6-98e3-2540a451bfa1 service nova] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0556c1d-e92c-48af-98f3-67f98c29a0e0 req-f7d6e1de-3a97-41b6-98e3-2540a451bfa1 service nova] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b0556c1d-e92c-48af-98f3-67f98c29a0e0 req-f7d6e1de-3a97-41b6-98e3-2540a451bfa1 service nova] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-b0556c1d-e92c-48af-98f3-67f98c29a0e0 req-f7d6e1de-3a97-41b6-98e3-2540a451bfa1 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] No waiting events found dispatching network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:59:20 user nova-compute[75215]: WARNING nova.compute.manager [req-b0556c1d-e92c-48af-98f3-67f98c29a0e0 req-f7d6e1de-3a97-41b6-98e3-2540a451bfa1 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received unexpected event network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 for instance with vm_state building and task_state spawning.
Nov 11 01:59:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:59:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:59:22 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Instance spawned successfully.
Nov 11 01:59:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:59:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:59:22 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:59:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-808db450-5996-440b-9217-d241d4b3f778 req-baada6a2-d08c-40ea-abe0-1a06feec99fb service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-808db450-5996-440b-9217-d241d4b3f778 req-baada6a2-d08c-40ea-abe0-1a06feec99fb service nova] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-808db450-5996-440b-9217-d241d4b3f778 req-baada6a2-d08c-40ea-abe0-1a06feec99fb service nova] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-808db450-5996-440b-9217-d241d4b3f778 req-baada6a2-d08c-40ea-abe0-1a06feec99fb service nova] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:22 user nova-compute[75215]: DEBUG nova.compute.manager [req-808db450-5996-440b-9217-d241d4b3f778 req-baada6a2-d08c-40ea-abe0-1a06feec99fb service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] No waiting events found dispatching network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:59:22 user nova-compute[75215]: WARNING nova.compute.manager [req-808db450-5996-440b-9217-d241d4b3f778 req-baada6a2-d08c-40ea-abe0-1a06feec99fb service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received unexpected event network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 for instance with vm_state building and task_state spawning.
Nov 11 01:59:22 user nova-compute[75215]: INFO nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 11 01:59:22 user nova-compute[75215]: DEBUG nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:59:22 user nova-compute[75215]: INFO nova.compute.manager [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Took 7.25 seconds to build instance.
Nov 11 01:59:22 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-0e1320dd-f143-4eee-85d3-549e6c51be6d tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.353s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:28 user nova-compute[75215]: INFO nova.compute.manager [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Detaching volume 704fe72a-b356-465d-a73a-3ffde2c804d6
Nov 11 01:59:29 user nova-compute[75215]: INFO nova.virt.block_device [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Attempting to driver detach volume 704fe72a-b356-465d-a73a-3ffde2c804d6 from mountpoint /dev/vdb
Nov 11 01:59:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Attempting to detach device vdb from instance d98d2519-070b-4eca-ab05-be3bd1661c61 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:59:29 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:59:29 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:59:29 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:59:29 user nova-compute[75215]:   <serial>704fe72a-b356-465d-a73a-3ffde2c804d6</serial>
Nov 11 01:59:29 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:59:29 user nova-compute[75215]: </disk>
Nov 11 01:59:29 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Successfully detached device vdb from instance d98d2519-070b-4eca-ab05-be3bd1661c61 from the persistent domain config.
Nov 11 01:59:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d98d2519-070b-4eca-ab05-be3bd1661c61 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 01:59:29 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 01:59:29 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 01:59:29 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 01:59:29 user nova-compute[75215]:   <serial>704fe72a-b356-465d-a73a-3ffde2c804d6</serial>
Nov 11 01:59:29 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 01:59:29 user nova-compute[75215]: </disk>
Nov 11 01:59:29 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d98d2519-070b-4eca-ab05-be3bd1661c61 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:59:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8204MB free_disk=24.99664306640625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance d98d2519-070b-4eca-ab05-be3bd1661c61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 101432ed-bf0f-4086-9523-21a7bee1d9b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 905d9e3a-da73-49a4-8548-81512b37fb86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0cfc863d-7a90-4cc7-8127-206b85037b16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:59:31 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:59:32 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 01:59:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:59:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 01:59:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:59:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 01:59:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:59:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 01:59:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:59:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:59:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 01:59:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updating instance_info_cache with network_info: [{"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:59:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:59:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 01:59:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 01:59:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 01:59:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d98d2519-070b-4eca-ab05-be3bd1661c61 is timed out.
Nov 11 01:59:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Successfully detached device vdb from instance d98d2519-070b-4eca-ab05-be3bd1661c61 from the live domain config.
Nov 11 01:59:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAXUmpev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:59:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[240b9117-1227-41c5-b23c-a4b706f80f92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:59:49 user nova-compute[75215]: No targets found.
Nov 11 01:59:49 user nova-compute[75215]: iSNS:
Nov 11 01:59:49 user nova-compute[75215]: No targets found.
Nov 11 01:59:49 user nova-compute[75215]: STATIC:
Nov 11 01:59:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6
Nov 11 01:59:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:59:49 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:59:49 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594
Nov 11 01:59:49 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:59:49 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:59:49 user nova-compute[75215]: FIRMWARE:
Nov 11 01:59:49 user nova-compute[75215]: No targets found.
Nov 11 01:59:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:59:49 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:59:49 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ebd068-6a32-40cb-8d4d-e6e1bcd12169]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b354cc4-932a-4f5e-b95c-6ccdf743c7af]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:59:49 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)
Nov 11 01:59:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 (non-flash)
Nov 11 01:59:49 user nova-compute[75215]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)
Nov 11 01:59:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404437f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a91a54c-4372-4764-ad44-c4c53ff0df50]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2027bd-e16c-4379-9368-fbf63b991222]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e10b68-2fd1-4f9f-9d9e-2c98c71ff6a4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb6d93-72ab-4d75-a437-fad134d1cdc6]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f585fb8-f104-47ff-84fc-744b628e33da]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f6cc5f-36b7-4ca5-8d26-f34c5bbbb259]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6, portal: 172.16.0.220,3260]
Nov 11 01:59:49 user nova-compute[75215]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6, portal: 172.16.0.220,3260] successful.
Nov 11 01:59:49 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fbd4b9-74f2-4e33-9e6a-b108983fa303]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] <== disconnect_volume: return (329ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:59:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:59:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:50 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'flavor' on Instance uuid d98d2519-070b-4eca-ab05-be3bd1661c61 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f22d3132-796b-4874-a1b9-125bdc7e6541 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.982s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.844s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:50 user nova-compute[75215]: INFO nova.compute.manager [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Terminating instance
Nov 11 01:59:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "7957c525-01f2-4fbb-924d-78294385345a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "7957c525-01f2-4fbb-924d-78294385345a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-6bd18887-53a3-4470-be8e-2525a9c545da req-729c11f2-4d10-4411-b813-341078431acc service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received event network-vif-unplugged-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6bd18887-53a3-4470-be8e-2525a9c545da req-729c11f2-4d10-4411-b813-341078431acc service nova] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6bd18887-53a3-4470-be8e-2525a9c545da req-729c11f2-4d10-4411-b813-341078431acc service nova] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6bd18887-53a3-4470-be8e-2525a9c545da req-729c11f2-4d10-4411-b813-341078431acc service nova] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-6bd18887-53a3-4470-be8e-2525a9c545da req-729c11f2-4d10-4411-b813-341078431acc service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] No waiting events found dispatching network-vif-unplugged-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-6bd18887-53a3-4470-be8e-2525a9c545da req-729c11f2-4d10-4411-b813-341078431acc service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received event network-vif-unplugged-652c0af1-c29a-4917-afad-6f4f51211124 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 01:59:51 user nova-compute[75215]: INFO nova.compute.claims [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Claim successful on node user
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 01:59:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Instance destroyed successfully.
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'resources' on Instance uuid d98d2519-070b-4eca-ab05-be3bd1661c61 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:59:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1068879769',display_name='tempest-VolumesSnapshotTestJSON-instance-1068879769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1068879769',id=40,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPPPkJMmlEMDuslKBccQN+MzKWdizz1xbAFw3q5sXy9ceCqv8GGs3sR88KPwgnpV0bFO2JtRtKygtS05HmVajbuF0qsccSns6m8NtAEJGlP/u3g4Muvz1bO16vVl/XAg==',key_name='tempest-keypair-2026813253',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:55:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1d8b6989b5d40399667cb0b36e0caab',ramdisk_id='',reservation_id='r-azuje9x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-95388186',owner_user_name='tempest-VolumesSnapshotTestJSON-95388186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:55:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e69b0fcf8943a4b3fcb905fb7e02b1',uuid=d98d2519-070b-4eca-ab05-be3bd1661c61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converting VIF {"id": "652c0af1-c29a-4917-afad-6f4f51211124", "address": "fa:16:3e:1f:2b:10", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652c0af1-c2", "ovs_interfaceid": "652c0af1-c29a-4917-afad-6f4f51211124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2b:10,bridge_name='br-int',has_traffic_filtering=True,id=652c0af1-c29a-4917-afad-6f4f51211124,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652c0af1-c2') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG os_vif [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2b:10,bridge_name='br-int',has_traffic_filtering=True,id=652c0af1-c29a-4917-afad-6f4f51211124,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652c0af1-c2') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap652c0af1-c2, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69746406-9e96-4f25-900f-79d3f95b8094) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:59:51 user nova-compute[75215]: INFO os_vif [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2b:10,bridge_name='br-int',has_traffic_filtering=True,id=652c0af1-c29a-4917-afad-6f4f51211124,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652c0af1-c2')
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAXUmpev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 01:59:51 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 01:59:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG nova.policy [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'faa7793f9ad2446eb57cc512a1972c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd080e37617456483a3f83f48d5811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c2a04b-1094-446b-815d-2832439e40b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 01:59:51 user nova-compute[75215]: No targets found.
Nov 11 01:59:51 user nova-compute[75215]: iSNS:
Nov 11 01:59:51 user nova-compute[75215]: No targets found.
Nov 11 01:59:51 user nova-compute[75215]: STATIC:
Nov 11 01:59:51 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594
Nov 11 01:59:51 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 01:59:51 user nova-compute[75215]:                 Iface Name: default
Nov 11 01:59:51 user nova-compute[75215]: FIRMWARE:
Nov 11 01:59:51 user nova-compute[75215]: No targets found.
Nov 11 01:59:51 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 01:59:51 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 01:59:51 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:704fe72a-b356-465d-a73a-3ffde2c804d6', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b95a72-4044-4f97-a854-ca7bcfc2ac72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:51 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[712c34f8-7722-47d5-b6cf-198c81057496]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)
Nov 11 01:59:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)
Nov 11 01:59:52 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40441767a0>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.471s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] <== disconnect_volume: return (472ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 01:59:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Deleting instance files /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61_del
Nov 11 01:59:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Deletion of /opt/stack/data/nova/instances/d98d2519-070b-4eca-ab05-be3bd1661c61_del complete
Nov 11 01:59:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 01:59:52 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Creating image(s)
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "/opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "/opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "/opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:52 user nova-compute[75215]: INFO nova.compute.manager [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Successfully created port: 29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.231s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk 1073741824" returned: 0 in 0.052s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 01:59:52 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Cannot resize image /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Ensure instance console log exists: /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Successfully updated port: 29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquired lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-1b840edb-ad3d-4c00-9877-32c6f44dee1a req-e10e35f9-615d-4c09-a935-806a4e63a244 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received event network-changed-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-1b840edb-ad3d-4c00-9877-32c6f44dee1a req-e10e35f9-615d-4c09-a935-806a4e63a244 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Refreshing instance network info cache due to event network-changed-29f942b3-f659-478c-868f-8ffe07ed99e6. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b840edb-ad3d-4c00-9877-32c6f44dee1a req-e10e35f9-615d-4c09-a935-806a4e63a244 service nova] Acquiring lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 01:59:53 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Took 0.88 seconds to deallocate network for instance.
Nov 11 01:59:53 user nova-compute[75215]: WARNING nova.volume.cinder [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Attachment 7c066217-8c8f-47ee-8854-04afb497d3e3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7c066217-8c8f-47ee-8854-04afb497d3e3. (HTTP 404) (Request-ID: req-b17aceb4-adeb-493b-b9b5-94c6e422eac8)
Nov 11 01:59:53 user nova-compute[75215]: INFO nova.compute.manager [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Took 0.03 seconds to detach 1 volumes for instance.
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-068a6cd3-a38a-418d-aa46-186ea63f2e07 req-596a5c24-812a-4188-9301-8ba4a84c4b0d service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received event network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-068a6cd3-a38a-418d-aa46-186ea63f2e07 req-596a5c24-812a-4188-9301-8ba4a84c4b0d service nova] Acquiring lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-068a6cd3-a38a-418d-aa46-186ea63f2e07 req-596a5c24-812a-4188-9301-8ba4a84c4b0d service nova] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-068a6cd3-a38a-418d-aa46-186ea63f2e07 req-596a5c24-812a-4188-9301-8ba4a84c4b0d service nova] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-068a6cd3-a38a-418d-aa46-186ea63f2e07 req-596a5c24-812a-4188-9301-8ba4a84c4b0d service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] No waiting events found dispatching network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:59:53 user nova-compute[75215]: WARNING nova.compute.manager [req-068a6cd3-a38a-418d-aa46-186ea63f2e07 req-596a5c24-812a-4188-9301-8ba4a84c4b0d service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received unexpected event network-vif-plugged-652c0af1-c29a-4917-afad-6f4f51211124 for instance with vm_state deleted and task_state None.
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [req-068a6cd3-a38a-418d-aa46-186ea63f2e07 req-596a5c24-812a-4188-9301-8ba4a84c4b0d service nova] [instance: d98d2519-070b-4eca-ab05-be3bd1661c61] Received event network-vif-deleted-652c0af1-c29a-4917-afad-6f4f51211124 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.neutron [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updating instance_info_cache with network_info: [{"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Releasing lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Instance network_info: |[{"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b840edb-ad3d-4c00-9877-32c6f44dee1a req-e10e35f9-615d-4c09-a935-806a4e63a244 service nova] Acquired lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.neutron [req-1b840edb-ad3d-4c00-9877-32c6f44dee1a req-e10e35f9-615d-4c09-a935-806a4e63a244 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Refreshing network info cache for port 29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Start _get_guest_xml network_info=[{"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 01:59:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:59:53 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 01:59:53 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Deleted allocations for instance d98d2519-070b-4eca-ab05-be3bd1661c61
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-914582135',display_name='tempest-ServersNegativeTestJSON-server-914582135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-914582135',id=44,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd080e37617456483a3f83f48d5811e',ramdisk_id='',reservation_id='r-yhhxovpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1091055269',owner_user_name='tempest-ServersNegativeTestJSON-1091055269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:59:52Z,user_data=None,user_id='faa7793f9ad2446eb57cc512a1972c07',uuid=7957c525-01f2-4fbb-924d-78294385345a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converting VIF {"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:88,bridge_name='br-int',has_traffic_filtering=True,id=29f942b3-f659-478c-868f-8ffe07ed99e6,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f942b3-f6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.objects.instance [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lazy-loading 'pci_devices' on Instance uuid 7957c525-01f2-4fbb-924d-78294385345a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] End _get_guest_xml xml=<domain type="kvm">
Nov 11 01:59:53 user nova-compute[75215]:   <uuid>7957c525-01f2-4fbb-924d-78294385345a</uuid>
Nov 11 01:59:53 user nova-compute[75215]:   <name>instance-0000002c</name>
Nov 11 01:59:53 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 01:59:53 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 01:59:53 user nova-compute[75215]:   <metadata>
Nov 11 01:59:53 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 01:59:53 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 01:59:53 user nova-compute[75215]:       <nova:name>tempest-ServersNegativeTestJSON-server-914582135</nova:name>
Nov 11 01:59:53 user nova-compute[75215]:       <nova:creationTime>2023-11-11 01:59:53</nova:creationTime>
Nov 11 01:59:53 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 01:59:53 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 01:59:53 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 01:59:53 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 01:59:53 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 01:59:53 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 01:59:53 user nova-compute[75215]:       </nova:flavor>
Nov 11 01:59:53 user nova-compute[75215]:       <nova:owner>
Nov 11 01:59:53 user nova-compute[75215]:         <nova:user uuid="faa7793f9ad2446eb57cc512a1972c07">tempest-ServersNegativeTestJSON-1091055269-project-member</nova:user>
Nov 11 01:59:53 user nova-compute[75215]:         <nova:project uuid="bfd080e37617456483a3f83f48d5811e">tempest-ServersNegativeTestJSON-1091055269</nova:project>
Nov 11 01:59:53 user nova-compute[75215]:       </nova:owner>
Nov 11 01:59:53 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 01:59:53 user nova-compute[75215]:       <nova:ports>
Nov 11 01:59:53 user nova-compute[75215]:         <nova:port uuid="29f942b3-f659-478c-868f-8ffe07ed99e6">
Nov 11 01:59:53 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 01:59:53 user nova-compute[75215]:         </nova:port>
Nov 11 01:59:53 user nova-compute[75215]:       </nova:ports>
Nov 11 01:59:53 user nova-compute[75215]:     </nova:instance>
Nov 11 01:59:53 user nova-compute[75215]:   </metadata>
Nov 11 01:59:53 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 01:59:53 user nova-compute[75215]:     <system>
Nov 11 01:59:53 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 01:59:53 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 01:59:53 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 01:59:53 user nova-compute[75215]:       <entry name="serial">7957c525-01f2-4fbb-924d-78294385345a</entry>
Nov 11 01:59:53 user nova-compute[75215]:       <entry name="uuid">7957c525-01f2-4fbb-924d-78294385345a</entry>
Nov 11 01:59:53 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 01:59:53 user nova-compute[75215]:     </system>
Nov 11 01:59:53 user nova-compute[75215]:   </sysinfo>
Nov 11 01:59:53 user nova-compute[75215]:   <os>
Nov 11 01:59:53 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 01:59:53 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 01:59:53 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 01:59:53 user nova-compute[75215]:   </os>
Nov 11 01:59:53 user nova-compute[75215]:   <features>
Nov 11 01:59:53 user nova-compute[75215]:     <acpi/>
Nov 11 01:59:53 user nova-compute[75215]:     <apic/>
Nov 11 01:59:53 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 01:59:53 user nova-compute[75215]:   </features>
Nov 11 01:59:53 user nova-compute[75215]:   <clock offset="utc">
Nov 11 01:59:53 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 01:59:53 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 01:59:53 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 01:59:53 user nova-compute[75215]:   </clock>
Nov 11 01:59:53 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 01:59:53 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 01:59:53 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 01:59:53 user nova-compute[75215]:   </cpu>
Nov 11 01:59:53 user nova-compute[75215]:   <devices>
Nov 11 01:59:53 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 01:59:53 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 01:59:53 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk"/>
Nov 11 01:59:53 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 01:59:53 user nova-compute[75215]:     </disk>
Nov 11 01:59:53 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 01:59:53 user nova-compute[75215]:       <mac address="fa:16:3e:7c:07:88"/>
Nov 11 01:59:53 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:59:53 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 01:59:53 user nova-compute[75215]:       <target dev="tap29f942b3-f6"/>
Nov 11 01:59:53 user nova-compute[75215]:     </interface>
Nov 11 01:59:53 user nova-compute[75215]:     <serial type="pty">
Nov 11 01:59:53 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/console.log" append="off"/>
Nov 11 01:59:53 user nova-compute[75215]:     </serial>
Nov 11 01:59:53 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 01:59:53 user nova-compute[75215]:     <video>
Nov 11 01:59:53 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 01:59:53 user nova-compute[75215]:     </video>
Nov 11 01:59:53 user nova-compute[75215]:     <rng model="virtio">
Nov 11 01:59:53 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 01:59:53 user nova-compute[75215]:     </rng>
Nov 11 01:59:53 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 01:59:53 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 01:59:53 user nova-compute[75215]:       <stats period="10"/>
Nov 11 01:59:53 user nova-compute[75215]:     </memballoon>
Nov 11 01:59:53 user nova-compute[75215]:   </devices>
Nov 11 01:59:53 user nova-compute[75215]: </domain>
Nov 11 01:59:53 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-914582135',display_name='tempest-ServersNegativeTestJSON-server-914582135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-914582135',id=44,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd080e37617456483a3f83f48d5811e',ramdisk_id='',reservation_id='r-yhhxovpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1091055269',owner_user_name='tempest-ServersNegativeTestJSON-1091055269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T01:59:52Z,user_data=None,user_id='faa7793f9ad2446eb57cc512a1972c07',uuid=7957c525-01f2-4fbb-924d-78294385345a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converting VIF {"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:88,bridge_name='br-int',has_traffic_filtering=True,id=29f942b3-f659-478c-868f-8ffe07ed99e6,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f942b3-f6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG os_vif [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:88,bridge_name='br-int',has_traffic_filtering=True,id=29f942b3-f659-478c-868f-8ffe07ed99e6,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f942b3-f6') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a95f84c8-4476-5787-b93d-bea4a8c02856', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29f942b3-f6, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29f942b3-f6, col_values=(('qos', UUID('55a6fd2c-d7dd-465b-83b6-8427126c7d0a')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29f942b3-f6, col_values=(('external_ids', {'iface-id': '29f942b3-f659-478c-868f-8ffe07ed99e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:07:88', 'vm-uuid': '7957c525-01f2-4fbb-924d-78294385345a'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:53 user nova-compute[75215]: INFO os_vif [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:88,bridge_name='br-int',has_traffic_filtering=True,id=29f942b3-f659-478c-868f-8ffe07ed99e6,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f942b3-f6')
Nov 11 01:59:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f197539f-e8ba-4bab-a4c6-1b659a38bd11 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "d98d2519-070b-4eca-ab05-be3bd1661c61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.795s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 01:59:53 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] No VIF found with MAC fa:16:3e:7c:07:88, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 01:59:54 user nova-compute[75215]: DEBUG nova.network.neutron [req-1b840edb-ad3d-4c00-9877-32c6f44dee1a req-e10e35f9-615d-4c09-a935-806a4e63a244 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updated VIF entry in instance network info cache for port 29f942b3-f659-478c-868f-8ffe07ed99e6. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 01:59:54 user nova-compute[75215]: DEBUG nova.network.neutron [req-1b840edb-ad3d-4c00-9877-32c6f44dee1a req-e10e35f9-615d-4c09-a935-806a4e63a244 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updating instance_info_cache with network_info: [{"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 01:59:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-1b840edb-ad3d-4c00-9877-32c6f44dee1a req-e10e35f9-615d-4c09-a935-806a4e63a244 service nova] Releasing lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-e183cdb4-c305-4663-a046-5eb0394dae24 req-2b440962-c13f-48ea-9663-6118ef6da677 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received event network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e183cdb4-c305-4663-a046-5eb0394dae24 req-2b440962-c13f-48ea-9663-6118ef6da677 service nova] Acquiring lock "7957c525-01f2-4fbb-924d-78294385345a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e183cdb4-c305-4663-a046-5eb0394dae24 req-2b440962-c13f-48ea-9663-6118ef6da677 service nova] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e183cdb4-c305-4663-a046-5eb0394dae24 req-2b440962-c13f-48ea-9663-6118ef6da677 service nova] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-e183cdb4-c305-4663-a046-5eb0394dae24 req-2b440962-c13f-48ea-9663-6118ef6da677 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] No waiting events found dispatching network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:59:55 user nova-compute[75215]: WARNING nova.compute.manager [req-e183cdb4-c305-4663-a046-5eb0394dae24 req-2b440962-c13f-48ea-9663-6118ef6da677 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received unexpected event network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 for instance with vm_state building and task_state spawning.
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 01:59:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Instance spawned successfully.
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 01:59:57 user nova-compute[75215]: INFO nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e9d07a44-ed88-40e3-81ec-01cd9d3787ac req-6f9ac765-87a5-4b10-bdbe-376f2584cb9c service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received event network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e9d07a44-ed88-40e3-81ec-01cd9d3787ac req-6f9ac765-87a5-4b10-bdbe-376f2584cb9c service nova] Acquiring lock "7957c525-01f2-4fbb-924d-78294385345a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e9d07a44-ed88-40e3-81ec-01cd9d3787ac req-6f9ac765-87a5-4b10-bdbe-376f2584cb9c service nova] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e9d07a44-ed88-40e3-81ec-01cd9d3787ac req-6f9ac765-87a5-4b10-bdbe-376f2584cb9c service nova] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-e9d07a44-ed88-40e3-81ec-01cd9d3787ac req-6f9ac765-87a5-4b10-bdbe-376f2584cb9c service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] No waiting events found dispatching network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 01:59:57 user nova-compute[75215]: WARNING nova.compute.manager [req-e9d07a44-ed88-40e3-81ec-01cd9d3787ac req-6f9ac765-87a5-4b10-bdbe-376f2584cb9c service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received unexpected event network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 for instance with vm_state building and task_state spawning.
Nov 11 01:59:57 user nova-compute[75215]: INFO nova.compute.manager [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Took 6.18 seconds to build instance.
Nov 11 01:59:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-56c81950-30d7-48c9-9f04-e32b851461f1 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "7957c525-01f2-4fbb-924d-78294385345a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.281s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 01:59:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:08 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:00:13 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG nova.objects.instance [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'flavor' on Instance uuid 905d9e3a-da73-49a4-8548-81512b37fb86 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:16 user nova-compute[75215]: INFO nova.compute.manager [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Attaching volume 5c8f33bd-7a20-4ab3-ae53-842f25ecd41d to /dev/vdb
Nov 11 02:00:16 user nova-compute[75215]: DEBUG os_brick.utils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[55055200-e079-4f69-8fe5-80700ace24bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b8054f-1b38-4f76-a07c-0ad9a2490a68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c7ea59-aab0-4e23-ac3f-80154e41448e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cfa374-9b21-4c68-840b-dc9ddb8ca76d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:00:16 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:00:16 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aae797-571e-46a0-b72d-c3330a7c7248]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:00:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:00:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:00:17 user nova-compute[75215]: DEBUG os_brick.utils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:00:17 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating existing volume attachment record: 67f8ed2e-a83b-4af5-93f6-edb30bbce8cf {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:00:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "101432ed-bf0f-4086-9523-21a7bee1d9b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:25 user nova-compute[75215]: INFO nova.compute.manager [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Terminating instance
Nov 11 02:00:25 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-d809397c-316b-4cc0-9049-9bce4e42fe72 req-154e7e5b-bd07-43fe-98c0-b40f6efe0f56 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received event network-vif-unplugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d809397c-316b-4cc0-9049-9bce4e42fe72 req-154e7e5b-bd07-43fe-98c0-b40f6efe0f56 service nova] Acquiring lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d809397c-316b-4cc0-9049-9bce4e42fe72 req-154e7e5b-bd07-43fe-98c0-b40f6efe0f56 service nova] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d809397c-316b-4cc0-9049-9bce4e42fe72 req-154e7e5b-bd07-43fe-98c0-b40f6efe0f56 service nova] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-d809397c-316b-4cc0-9049-9bce4e42fe72 req-154e7e5b-bd07-43fe-98c0-b40f6efe0f56 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] No waiting events found dispatching network-vif-unplugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:00:25 user nova-compute[75215]: DEBUG nova.compute.manager [req-d809397c-316b-4cc0-9049-9bce4e42fe72 req-154e7e5b-bd07-43fe-98c0-b40f6efe0f56 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received event network-vif-unplugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:00:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Instance destroyed successfully.
Nov 11 02:00:26 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'resources' on Instance uuid 101432ed-bf0f-4086-9523-21a7bee1d9b0 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-41185756',display_name='tempest-TestVolumeBootPattern-server-41185756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-41185756',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-uzwqx1kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:58:45Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=101432ed-bf0f-4086-9523-21a7bee1d9b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "address": "fa:16:3e:55:3d:ed", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01956a0c-96", "ovs_interfaceid": "01956a0c-96d9-4e68-b7ae-86cb8499c4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=01956a0c-96d9-4e68-b7ae-86cb8499c4b9,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01956a0c-96') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_vif [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=01956a0c-96d9-4e68-b7ae-86cb8499c4b9,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01956a0c-96') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01956a0c-96, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cdfa5df-204e-4f8b-8f6a-e676de47ec61) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:26 user nova-compute[75215]: INFO os_vif [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=01956a0c-96d9-4e68-b7ae-86cb8499c4b9,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01956a0c-96')
Nov 11 02:00:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aUSGyczF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:00:26 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b867204-24c1-4a7c-bf36-99839c3754ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:00:26 user nova-compute[75215]: No targets found.
Nov 11 02:00:26 user nova-compute[75215]: iSNS:
Nov 11 02:00:26 user nova-compute[75215]: No targets found.
Nov 11 02:00:26 user nova-compute[75215]: STATIC:
Nov 11 02:00:26 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594
Nov 11 02:00:26 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:00:26 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:00:26 user nova-compute[75215]: FIRMWARE:
Nov 11 02:00:26 user nova-compute[75215]: No targets found.
Nov 11 02:00:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:00:26 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:00:26 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a02626-e694-40f8-927c-091619830258]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba0749c-0ef8-4dbb-86c2-7494324264df]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)
Nov 11 02:00:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 (non-flash)
Nov 11 02:00:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40642fa200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f3c97-8fd8-44f4-9551-2eae1ca7dd6c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4fe94e-00e4-4582-8ef1-7ea0eeb6b5c9]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6ae89d-2f77-4152-809b-57c26cba6f9d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d9eec6-a6f4-4958-becb-f719c6a32a46]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1e823aa6-9907ddd8e0edbf80', '/dev/disk/by-id/scsi-23939303764646438', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1e823aa6') {{(pid=86647) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea244bdb-0e37-4040-92d2-e8656dd2fcae]: (4, None) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8be5fd-b63d-457b-8d5e-0d7a13268875]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabd0e73-7347-465e-9715-35433b1ff4e3]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594, portal: 172.16.0.220,3260]
Nov 11 02:00:26 user nova-compute[75215]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594, portal: 172.16.0.220,3260] successful.
Nov 11 02:00:26 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354140a4-65b9-4fd0-8353-f190c4757594 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e70d33e-88a9-4181-a2a3-8d4758703eba]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== disconnect_volume: return (332ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:00:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Deleting instance files /opt/stack/data/nova/instances/101432ed-bf0f-4086-9523-21a7bee1d9b0_del
Nov 11 02:00:26 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Deletion of /opt/stack/data/nova/instances/101432ed-bf0f-4086-9523-21a7bee1d9b0_del complete
Nov 11 02:00:26 user nova-compute[75215]: INFO nova.compute.manager [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 11 02:00:26 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:00:26 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:00:27 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:00:27 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Took 0.97 seconds to deallocate network for instance.
Nov 11 02:00:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-4cb69b67-1628-4b77-9526-98ee72a0c9b4 req-72723434-25a9-40bb-9dd4-2e46a0811815 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received event network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4cb69b67-1628-4b77-9526-98ee72a0c9b4 req-72723434-25a9-40bb-9dd4-2e46a0811815 service nova] Acquiring lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4cb69b67-1628-4b77-9526-98ee72a0c9b4 req-72723434-25a9-40bb-9dd4-2e46a0811815 service nova] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4cb69b67-1628-4b77-9526-98ee72a0c9b4 req-72723434-25a9-40bb-9dd4-2e46a0811815 service nova] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-4cb69b67-1628-4b77-9526-98ee72a0c9b4 req-72723434-25a9-40bb-9dd4-2e46a0811815 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] No waiting events found dispatching network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:00:28 user nova-compute[75215]: WARNING nova.compute.manager [req-4cb69b67-1628-4b77-9526-98ee72a0c9b4 req-72723434-25a9-40bb-9dd4-2e46a0811815 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received unexpected event network-vif-plugged-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 for instance with vm_state active and task_state deleting.
Nov 11 02:00:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-4cb69b67-1628-4b77-9526-98ee72a0c9b4 req-72723434-25a9-40bb-9dd4-2e46a0811815 service nova] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Received event network-vif-deleted-01956a0c-96d9-4e68-b7ae-86cb8499c4b9 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:00:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:00:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8353MB free_disk=24.98370361328125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 101432ed-bf0f-4086-9523-21a7bee1d9b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 905d9e3a-da73-49a4-8548-81512b37fb86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0cfc863d-7a90-4cc7-8127-206b85037b16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:00:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:00:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:00:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:00:32 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:00:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:00:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:39 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:00:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:00:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:00:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:00:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:00:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlIydKvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:00:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:00:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:00:42 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3345b690-c98c-45a1-8e4a-e33cc33d0c41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:00:42 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76803db-9088-42e2-98f1-53e45ccfde8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d] added
Nov 11 02:00:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae593f40-9ce1-4472-8c81-fb644ebbbf7d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e1b07a-b127-4741-98c3-08602ef03987]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AlIydKvq {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AlIydKvq" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5484c5b7-aa14-4671-95fb-06491a3d6e97]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AlIydKvq'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab9d85d-d569-4212-a7e3-e88c17fe8935]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a58ddca-7509-4220-8588-a05f5f66791e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 02:00:42 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 02:00:42 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:00:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 02:00:42 user nova-compute[75215]: 
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac63f38-7024-41ef-ba0b-6982ebc18f14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d, portal: 172.16.0.220,3260]
Nov 11 02:00:42 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d, portal: 172.16.0.220,3260] successful.
Nov 11 02:00:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f5890-02fa-40ce-a3b9-08d78145e97c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8114e48-bb17-4b32-a7bf-ccf4ab31a16f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:00:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:00:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[651aa21c-d102-4354-846b-918959d0ade7]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:00:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlIydKvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:00:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:00:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26461393933663930', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:00:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461393933663930', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:00:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'flavor' on Instance uuid 905d9e3a-da73-49a4-8548-81512b37fb86 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:00:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 02:00:43 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:00:43 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 02:00:43 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:00:43 user nova-compute[75215]:   <serial>5c8f33bd-7a20-4ab3-ae53-842f25ecd41d</serial>
Nov 11 02:00:43 user nova-compute[75215]: </disk>
Nov 11 02:00:43 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 02:00:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:00:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:00:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] No VIF found with MAC fa:16:3e:cc:50:3a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:00:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-333d1e28-1d67-4054-891d-2271d703c9e7 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.433s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:44 user nova-compute[75215]: INFO nova.compute.manager [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Took 17.01 seconds to detach 1 volumes for instance.
Nov 11 02:00:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 101432ed-bf0f-4086-9523-21a7bee1d9b0] Deleting volume: 354140a4-65b9-4fd0-8353-f190c4757594 {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 02:00:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:45 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:00:45 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:00:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:45 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Deleted allocations for instance 101432ed-bf0f-4086-9523-21a7bee1d9b0
Nov 11 02:00:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3bce5cf5-b5bd-4a76-a68a-1886608afb0d tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "101432ed-bf0f-4086-9523-21a7bee1d9b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.770s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-c803063a-fd55-4b1b-9e75-a92c477f2779 req-bcaf140f-5114-41e4-93a4-472e0c8b9f50 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-c803063a-fd55-4b1b-9e75-a92c477f2779 req-bcaf140f-5114-41e4-93a4-472e0c8b9f50 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing instance network info cache due to event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c803063a-fd55-4b1b-9e75-a92c477f2779 req-bcaf140f-5114-41e4-93a4-472e0c8b9f50 service nova] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c803063a-fd55-4b1b-9e75-a92c477f2779 req-bcaf140f-5114-41e4-93a4-472e0c8b9f50 service nova] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:00:46 user nova-compute[75215]: DEBUG nova.network.neutron [req-c803063a-fd55-4b1b-9e75-a92c477f2779 req-bcaf140f-5114-41e4-93a4-472e0c8b9f50 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:00:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-c803063a-fd55-4b1b-9e75-a92c477f2779 req-bcaf140f-5114-41e4-93a4-472e0c8b9f50 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updated VIF entry in instance network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:00:47 user nova-compute[75215]: DEBUG nova.network.neutron [req-c803063a-fd55-4b1b-9e75-a92c477f2779 req-bcaf140f-5114-41e4-93a4-472e0c8b9f50 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:00:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c803063a-fd55-4b1b-9e75-a92c477f2779 req-bcaf140f-5114-41e4-93a4-472e0c8b9f50 service nova] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:00:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-e76fa3f7-a3a0-456c-8abd-a78a5e094876 req-7ad3c88e-c69d-4b9e-9a81-0a6d77dde7e1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-e76fa3f7-a3a0-456c-8abd-a78a5e094876 req-7ad3c88e-c69d-4b9e-9a81-0a6d77dde7e1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing instance network info cache due to event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e76fa3f7-a3a0-456c-8abd-a78a5e094876 req-7ad3c88e-c69d-4b9e-9a81-0a6d77dde7e1 service nova] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e76fa3f7-a3a0-456c-8abd-a78a5e094876 req-7ad3c88e-c69d-4b9e-9a81-0a6d77dde7e1 service nova] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-e76fa3f7-a3a0-456c-8abd-a78a5e094876 req-7ad3c88e-c69d-4b9e-9a81-0a6d77dde7e1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-e76fa3f7-a3a0-456c-8abd-a78a5e094876 req-7ad3c88e-c69d-4b9e-9a81-0a6d77dde7e1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updated VIF entry in instance network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG nova.network.neutron [req-e76fa3f7-a3a0-456c-8abd-a78a5e094876 req-7ad3c88e-c69d-4b9e-9a81-0a6d77dde7e1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e76fa3f7-a3a0-456c-8abd-a78a5e094876 req-7ad3c88e-c69d-4b9e-9a81-0a6d77dde7e1 service nova] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:49 user nova-compute[75215]: INFO nova.compute.manager [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Rebooting instance
Nov 11 02:00:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:00:49 user nova-compute[75215]: DEBUG nova.network.neutron [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:00:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:00:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:00:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:00:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e5eb3cd-d67c-4908-9561-f05beeff1f56 req-5f1df039-f53e-4d88-afa1-e870a38cb98e service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-unplugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e5eb3cd-d67c-4908-9561-f05beeff1f56 req-5f1df039-f53e-4d88-afa1-e870a38cb98e service nova] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e5eb3cd-d67c-4908-9561-f05beeff1f56 req-5f1df039-f53e-4d88-afa1-e870a38cb98e service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3e5eb3cd-d67c-4908-9561-f05beeff1f56 req-5f1df039-f53e-4d88-afa1-e870a38cb98e service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-3e5eb3cd-d67c-4908-9561-f05beeff1f56 req-5f1df039-f53e-4d88-afa1-e870a38cb98e service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] No waiting events found dispatching network-vif-unplugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:00:52 user nova-compute[75215]: WARNING nova.compute.manager [req-3e5eb3cd-d67c-4908-9561-f05beeff1f56 req-5f1df039-f53e-4d88-afa1-e870a38cb98e service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received unexpected event network-vif-unplugged-8bd632f6-8b87-4591-99d1-d40b8571210f for instance with vm_state active and task_state reboot_started.
Nov 11 02:00:53 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Instance shutdown successfully.
Nov 11 02:00:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-859fa0bd-4b70-41b4-a854-eab31a24af6d req-7c5c1cd2-e6ee-423b-b3af-730e48ddf298 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-859fa0bd-4b70-41b4-a854-eab31a24af6d req-7c5c1cd2-e6ee-423b-b3af-730e48ddf298 service nova] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-859fa0bd-4b70-41b4-a854-eab31a24af6d req-7c5c1cd2-e6ee-423b-b3af-730e48ddf298 service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-859fa0bd-4b70-41b4-a854-eab31a24af6d req-7c5c1cd2-e6ee-423b-b3af-730e48ddf298 service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-859fa0bd-4b70-41b4-a854-eab31a24af6d req-7c5c1cd2-e6ee-423b-b3af-730e48ddf298 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] No waiting events found dispatching network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:00:54 user nova-compute[75215]: WARNING nova.compute.manager [req-859fa0bd-4b70-41b4-a854-eab31a24af6d req-7c5c1cd2-e6ee-423b-b3af-730e48ddf298 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received unexpected event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f for instance with vm_state active and task_state reboot_started.
Nov 11 02:00:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:00:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Instance running successfully.
Nov 11 02:00:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Instance soft rebooted successfully.
Nov 11 02:00:57 user nova-compute[75215]: DEBUG nova.compute.manager [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] No waiting events found dispatching network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:00:57 user nova-compute[75215]: WARNING nova.compute.manager [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received unexpected event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f for instance with vm_state active and task_state reboot_started.
Nov 11 02:00:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:00:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] No waiting events found dispatching network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:00:57 user nova-compute[75215]: WARNING nova.compute.manager [req-99ef6e1e-b639-4d45-a7b0-a1e261370f69 req-da0bf27e-79b2-40e1-9155-152546205b2a service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received unexpected event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f for instance with vm_state active and task_state reboot_started.
Nov 11 02:00:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-41307cba-6fd7-426a-af25-28f8787dd376 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.256s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-81d3c1e6-80d2-4134-81c7-9a8e968c3844 req-bef639ee-57ec-4ada-b851-be420dcf5a77 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-changed-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:01:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-81d3c1e6-80d2-4134-81c7-9a8e968c3844 req-bef639ee-57ec-4ada-b851-be420dcf5a77 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Refreshing instance network info cache due to event network-changed-e911ca15-640f-43a1-8ba7-6ea574c12db2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:01:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-81d3c1e6-80d2-4134-81c7-9a8e968c3844 req-bef639ee-57ec-4ada-b851-be420dcf5a77 service nova] Acquiring lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:01:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-81d3c1e6-80d2-4134-81c7-9a8e968c3844 req-bef639ee-57ec-4ada-b851-be420dcf5a77 service nova] Acquired lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:01:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-81d3c1e6-80d2-4134-81c7-9a8e968c3844 req-bef639ee-57ec-4ada-b851-be420dcf5a77 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Refreshing network info cache for port e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-81d3c1e6-80d2-4134-81c7-9a8e968c3844 req-bef639ee-57ec-4ada-b851-be420dcf5a77 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updated VIF entry in instance network info cache for port e911ca15-640f-43a1-8ba7-6ea574c12db2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG nova.network.neutron [req-81d3c1e6-80d2-4134-81c7-9a8e968c3844 req-bef639ee-57ec-4ada-b851-be420dcf5a77 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updating instance_info_cache with network_info: [{"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-81d3c1e6-80d2-4134-81c7-9a8e968c3844 req-bef639ee-57ec-4ada-b851-be420dcf5a77 service nova] Releasing lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'flavor' on Instance uuid 0cfc863d-7a90-4cc7-8127-206b85037b16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:08 user nova-compute[75215]: INFO nova.compute.manager [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Attaching volume c1c0c50b-8e40-4b03-956f-9bfdb9480f6c to /dev/vdb
Nov 11 02:01:08 user nova-compute[75215]: DEBUG os_brick.utils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c651f49-e6a7-46c6-ba2c-df734eac70c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[84835575-ae54-4517-9978-41ce69b3fd56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[621cb136-c00b-4585-94ff-d40130542cef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab9d4b9-9f44-4a76-9e21-b4c21b856ec4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:01:08 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:01:08 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f871b8-06ce-4958-9f23-b53f8d7713dc]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG os_brick.utils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:01:08 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updating existing volume attachment record: d0013a22-632b-4fad-b155-9de94179f032 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:01:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:29 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:29 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:01:31 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:01:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8443MB free_disk=24.979717254638672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 905d9e3a-da73-49a4-8548-81512b37fb86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0cfc863d-7a90-4cc7-8127-206b85037b16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:01:31 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:01:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:01:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGPTMsBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:01:33 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:01:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:01:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:01:33 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:01:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:01:33 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:01:33 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:01:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e13d8a-012e-4027-a979-8e257302293f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:01:34 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8262f4db-51b2-4784-9d2c-889c4dfc82ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c] added
Nov 11 02:01:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c04690a-7ecc-4c87-b61a-e30b6055d63c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a23d33c-227e-497a-b158-61faf7372ea2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGPTMsBi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGPTMsBi" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0e18d5-1a3e-4160-b731-9e34ff63ad1c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGPTMsBi'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a64ec2-2319-4775-b875-cc305c23138c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6243d29e-312b-45b1-84cd-d0be71391299]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:01:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:01:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f827d5d4-4eed-4155-9200-4ad276d035d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c, portal: 172.16.0.220,3260]
Nov 11 02:01:34 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c, portal: 172.16.0.220,3260] successful.
Nov 11 02:01:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf5ff3e-8ace-4b19-8a0f-576b928f675e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa39f78-5cb1-4fe2-ad58-64a4cefddc7e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:01:34 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c (non-flash)
Nov 11 02:01:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:01:34 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c (non-flash)
Nov 11 02:01:34 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[035621b8-02e1-4768-bb79-0effcbddaadc]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:01:34 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGPTMsBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26235313437313162', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235313437313162', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'flavor' on Instance uuid 0cfc863d-7a90-4cc7-8127-206b85037b16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 02:01:35 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:01:35 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 02:01:35 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:01:35 user nova-compute[75215]:   <serial>c1c0c50b-8e40-4b03-956f-9bfdb9480f6c</serial>
Nov 11 02:01:35 user nova-compute[75215]: </disk>
Nov 11 02:01:35 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] No VIF found with MAC fa:16:3e:09:81:f8, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:01:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f85d7c04-ba73-47ed-9770-cadd8d8d6b47 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.647s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:37 user nova-compute[75215]: INFO nova.compute.manager [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Detaching volume c1c0c50b-8e40-4b03-956f-9bfdb9480f6c
Nov 11 02:01:37 user nova-compute[75215]: INFO nova.virt.block_device [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Attempting to driver detach volume c1c0c50b-8e40-4b03-956f-9bfdb9480f6c from mountpoint /dev/vdb
Nov 11 02:01:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Attempting to detach device vdb from instance 0cfc863d-7a90-4cc7-8127-206b85037b16 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 02:01:37 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:01:37 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 02:01:37 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:01:37 user nova-compute[75215]:   <serial>c1c0c50b-8e40-4b03-956f-9bfdb9480f6c</serial>
Nov 11 02:01:37 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 02:01:37 user nova-compute[75215]: </disk>
Nov 11 02:01:37 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 02:01:37 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Successfully detached device vdb from instance 0cfc863d-7a90-4cc7-8127-206b85037b16 from the persistent domain config.
Nov 11 02:01:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0cfc863d-7a90-4cc7-8127-206b85037b16 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 02:01:37 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:01:37 user nova-compute[75215]:   <source dev="/dev/sdc"/>
Nov 11 02:01:37 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:01:37 user nova-compute[75215]:   <serial>c1c0c50b-8e40-4b03-956f-9bfdb9480f6c</serial>
Nov 11 02:01:37 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 02:01:37 user nova-compute[75215]: </disk>
Nov 11 02:01:37 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0cfc863d-7a90-4cc7-8127-206b85037b16 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:01:38 user nova-compute[75215]: INFO nova.compute.claims [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Claim successful on node user
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 02:01:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.policy [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55e69b0fcf8943a4b3fcb905fb7e02b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d8b6989b5d40399667cb0b36e0caab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:01:38 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Creating image(s)
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "/opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "/opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "/opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.378s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:38 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.238s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk 1073741824" returned: 0 in 0.053s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Successfully created port: afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Cannot resize image /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Ensure instance console log exists: /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:39 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Successfully updated port: afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquired lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-699601fd-35c8-4c67-aae0-a2bd4f3e7bb8 req-0f8f2b73-1da9-48a5-91e1-109b10946927 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-changed-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-699601fd-35c8-4c67-aae0-a2bd4f3e7bb8 req-0f8f2b73-1da9-48a5-91e1-109b10946927 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Refreshing instance network info cache due to event network-changed-afa87a4b-a5f1-4503-82ef-137ba0083bc0. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-699601fd-35c8-4c67-aae0-a2bd4f3e7bb8 req-0f8f2b73-1da9-48a5-91e1-109b10946927 service nova] Acquiring lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.neutron [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Updating instance_info_cache with network_info: [{"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Releasing lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Instance network_info: |[{"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-699601fd-35c8-4c67-aae0-a2bd4f3e7bb8 req-0f8f2b73-1da9-48a5-91e1-109b10946927 service nova] Acquired lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-699601fd-35c8-4c67-aae0-a2bd4f3e7bb8 req-0f8f2b73-1da9-48a5-91e1-109b10946927 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Refreshing network info cache for port afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Start _get_guest_xml network_info=[{"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:01:40 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:01:40 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-165983051',display_name='tempest-VolumesSnapshotTestJSON-instance-165983051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-165983051',id=45,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3u5YFdA2U1aPTNmV4pbOHswzyelItH34kjZhwnKdwyGYi375S+nnG0UizI+PkE0+rBiRfy5XwfhTcLBLB+TVgatkDdX6WsFWAK9+I5h22Sn43XGsqaqsZ/dAOIu2AD6Q==',key_name='tempest-keypair-1285395285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d8b6989b5d40399667cb0b36e0caab',ramdisk_id='',reservation_id='r-oykce6ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-95388186',owner_user_name='tempest-VolumesSnapshotTestJSON-95388186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e69b0fcf8943a4b3fcb905fb7e02b1',uuid=6696ee6b-11f3-45b1-b023-558ab78db2fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converting VIF {"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ef:6d,bridge_name='br-int',has_traffic_filtering=True,id=afa87a4b-a5f1-4503-82ef-137ba0083bc0,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa87a4b-a5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'pci_devices' on Instance uuid 6696ee6b-11f3-45b1-b023-558ab78db2fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:01:40 user nova-compute[75215]:   <uuid>6696ee6b-11f3-45b1-b023-558ab78db2fd</uuid>
Nov 11 02:01:40 user nova-compute[75215]:   <name>instance-0000002d</name>
Nov 11 02:01:40 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:01:40 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:01:40 user nova-compute[75215]:   <metadata>
Nov 11 02:01:40 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:01:40 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:01:40 user nova-compute[75215]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-165983051</nova:name>
Nov 11 02:01:40 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:01:40</nova:creationTime>
Nov 11 02:01:40 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:01:40 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:01:40 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:01:40 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:01:40 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:01:40 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:01:40 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:01:40 user nova-compute[75215]:       <nova:owner>
Nov 11 02:01:40 user nova-compute[75215]:         <nova:user uuid="55e69b0fcf8943a4b3fcb905fb7e02b1">tempest-VolumesSnapshotTestJSON-95388186-project-member</nova:user>
Nov 11 02:01:40 user nova-compute[75215]:         <nova:project uuid="e1d8b6989b5d40399667cb0b36e0caab">tempest-VolumesSnapshotTestJSON-95388186</nova:project>
Nov 11 02:01:40 user nova-compute[75215]:       </nova:owner>
Nov 11 02:01:40 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 02:01:40 user nova-compute[75215]:       <nova:ports>
Nov 11 02:01:40 user nova-compute[75215]:         <nova:port uuid="afa87a4b-a5f1-4503-82ef-137ba0083bc0">
Nov 11 02:01:40 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 02:01:40 user nova-compute[75215]:         </nova:port>
Nov 11 02:01:40 user nova-compute[75215]:       </nova:ports>
Nov 11 02:01:40 user nova-compute[75215]:     </nova:instance>
Nov 11 02:01:40 user nova-compute[75215]:   </metadata>
Nov 11 02:01:40 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:01:40 user nova-compute[75215]:     <system>
Nov 11 02:01:40 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:01:40 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:01:40 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:01:40 user nova-compute[75215]:       <entry name="serial">6696ee6b-11f3-45b1-b023-558ab78db2fd</entry>
Nov 11 02:01:40 user nova-compute[75215]:       <entry name="uuid">6696ee6b-11f3-45b1-b023-558ab78db2fd</entry>
Nov 11 02:01:40 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:01:40 user nova-compute[75215]:     </system>
Nov 11 02:01:40 user nova-compute[75215]:   </sysinfo>
Nov 11 02:01:40 user nova-compute[75215]:   <os>
Nov 11 02:01:40 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:01:40 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:01:40 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:01:40 user nova-compute[75215]:   </os>
Nov 11 02:01:40 user nova-compute[75215]:   <features>
Nov 11 02:01:40 user nova-compute[75215]:     <acpi/>
Nov 11 02:01:40 user nova-compute[75215]:     <apic/>
Nov 11 02:01:40 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:01:40 user nova-compute[75215]:   </features>
Nov 11 02:01:40 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:01:40 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:01:40 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:01:40 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:01:40 user nova-compute[75215]:   </clock>
Nov 11 02:01:40 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:01:40 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:01:40 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:01:40 user nova-compute[75215]:   </cpu>
Nov 11 02:01:40 user nova-compute[75215]:   <devices>
Nov 11 02:01:40 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 02:01:40 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 02:01:40 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk"/>
Nov 11 02:01:40 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:01:40 user nova-compute[75215]:     </disk>
Nov 11 02:01:40 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:01:40 user nova-compute[75215]:       <mac address="fa:16:3e:6b:ef:6d"/>
Nov 11 02:01:40 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:01:40 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:01:40 user nova-compute[75215]:       <target dev="tapafa87a4b-a5"/>
Nov 11 02:01:40 user nova-compute[75215]:     </interface>
Nov 11 02:01:40 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:01:40 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/console.log" append="off"/>
Nov 11 02:01:40 user nova-compute[75215]:     </serial>
Nov 11 02:01:40 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:01:40 user nova-compute[75215]:     <video>
Nov 11 02:01:40 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:01:40 user nova-compute[75215]:     </video>
Nov 11 02:01:40 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:01:40 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:01:40 user nova-compute[75215]:     </rng>
Nov 11 02:01:40 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:01:40 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:01:40 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:01:40 user nova-compute[75215]:     </memballoon>
Nov 11 02:01:40 user nova-compute[75215]:   </devices>
Nov 11 02:01:40 user nova-compute[75215]: </domain>
Nov 11 02:01:40 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-165983051',display_name='tempest-VolumesSnapshotTestJSON-instance-165983051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-165983051',id=45,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3u5YFdA2U1aPTNmV4pbOHswzyelItH34kjZhwnKdwyGYi375S+nnG0UizI+PkE0+rBiRfy5XwfhTcLBLB+TVgatkDdX6WsFWAK9+I5h22Sn43XGsqaqsZ/dAOIu2AD6Q==',key_name='tempest-keypair-1285395285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d8b6989b5d40399667cb0b36e0caab',ramdisk_id='',reservation_id='r-oykce6ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-95388186',owner_user_name='tempest-VolumesSnapshotTestJSON-95388186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e69b0fcf8943a4b3fcb905fb7e02b1',uuid=6696ee6b-11f3-45b1-b023-558ab78db2fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converting VIF {"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ef:6d,bridge_name='br-int',has_traffic_filtering=True,id=afa87a4b-a5f1-4503-82ef-137ba0083bc0,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa87a4b-a5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG os_vif [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ef:6d,bridge_name='br-int',has_traffic_filtering=True,id=afa87a4b-a5f1-4503-82ef-137ba0083bc0,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa87a4b-a5') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ff7a2f3-ea60-54ad-876f-d76f6e30062f', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafa87a4b-a5, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafa87a4b-a5, col_values=(('qos', UUID('11b6f32a-bba8-48bf-9452-fc3bd2669e55')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafa87a4b-a5, col_values=(('external_ids', {'iface-id': 'afa87a4b-a5f1-4503-82ef-137ba0083bc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ef:6d', 'vm-uuid': '6696ee6b-11f3-45b1-b023-558ab78db2fd'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:40 user nova-compute[75215]: INFO os_vif [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ef:6d,bridge_name='br-int',has_traffic_filtering=True,id=afa87a4b-a5f1-4503-82ef-137ba0083bc0,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa87a4b-a5')
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No VIF found with MAC fa:16:3e:6b:ef:6d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-699601fd-35c8-4c67-aae0-a2bd4f3e7bb8 req-0f8f2b73-1da9-48a5-91e1-109b10946927 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Updated VIF entry in instance network info cache for port afa87a4b-a5f1-4503-82ef-137ba0083bc0. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG nova.network.neutron [req-699601fd-35c8-4c67-aae0-a2bd4f3e7bb8 req-0f8f2b73-1da9-48a5-91e1-109b10946927 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Updating instance_info_cache with network_info: [{"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:01:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-699601fd-35c8-4c67-aae0-a2bd4f3e7bb8 req-0f8f2b73-1da9-48a5-91e1-109b10946927 service nova] Releasing lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Skipping network cache update for instance because it is Building. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid c9b03800-0532-446a-b985-1507e3b4db3e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updating instance_info_cache with network_info: [{"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:01:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-16b660e5-71d3-4652-a464-0e97579473f3 req-0ed76551-3e3a-42a2-84a8-29390aa48213 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-16b660e5-71d3-4652-a464-0e97579473f3 req-0ed76551-3e3a-42a2-84a8-29390aa48213 service nova] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-16b660e5-71d3-4652-a464-0e97579473f3 req-0ed76551-3e3a-42a2-84a8-29390aa48213 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-16b660e5-71d3-4652-a464-0e97579473f3 req-0ed76551-3e3a-42a2-84a8-29390aa48213 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-16b660e5-71d3-4652-a464-0e97579473f3 req-0ed76551-3e3a-42a2-84a8-29390aa48213 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] No waiting events found dispatching network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:01:42 user nova-compute[75215]: WARNING nova.compute.manager [req-16b660e5-71d3-4652-a464-0e97579473f3 req-0ed76551-3e3a-42a2-84a8-29390aa48213 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received unexpected event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 for instance with vm_state building and task_state spawning.
Nov 11 02:01:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:01:42 user nova-compute[75215]: INFO nova.compute.claims [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Claim successful on node user
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 02:01:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:01:43 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Creating image(s)
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "/opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "/opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.204s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG nova.policy [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'faa7793f9ad2446eb57cc512a1972c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd080e37617456483a3f83f48d5811e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk 1073741824 {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137,backing_fmt=raw /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk 1073741824" returned: 0 in 0.061s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "47f6495ab3b8176c5a78e8f4d49574d92fdd0137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:43 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137 --force-share --output=json" returned: 0 in 0.191s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk. size=1073741824 {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.disk.api [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Cannot resize image /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk to a smaller size. {{(pid=75215) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Created local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Successfully created port: 244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:01:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Instance spawned successfully.
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-27b597fd-0ea0-4f6c-99aa-f7f79e1e196f req-e70b83b7-c0fc-4231-a10d-ad700f4f9b60 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27b597fd-0ea0-4f6c-99aa-f7f79e1e196f req-e70b83b7-c0fc-4231-a10d-ad700f4f9b60 service nova] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27b597fd-0ea0-4f6c-99aa-f7f79e1e196f req-e70b83b7-c0fc-4231-a10d-ad700f4f9b60 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-27b597fd-0ea0-4f6c-99aa-f7f79e1e196f req-e70b83b7-c0fc-4231-a10d-ad700f4f9b60 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-27b597fd-0ea0-4f6c-99aa-f7f79e1e196f req-e70b83b7-c0fc-4231-a10d-ad700f4f9b60 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] No waiting events found dispatching network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:01:44 user nova-compute[75215]: WARNING nova.compute.manager [req-27b597fd-0ea0-4f6c-99aa-f7f79e1e196f req-e70b83b7-c0fc-4231-a10d-ad700f4f9b60 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received unexpected event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 for instance with vm_state building and task_state spawning.
Nov 11 02:01:44 user nova-compute[75215]: INFO nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:01:44 user nova-compute[75215]: INFO nova.compute.manager [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Took 6.52 seconds to build instance.
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d28d2412-1608-4bb9-b7ac-4053d83bc5c0 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.618s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Successfully updated port: 244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "refresh_cache-3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquired lock "refresh_cache-3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-b06f47d7-d8d3-42ab-9627-573f1b35a007 req-2cb0ca8f-81f6-40c7-b7c1-5ef986d220a2 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received event network-changed-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-b06f47d7-d8d3-42ab-9627-573f1b35a007 req-2cb0ca8f-81f6-40c7-b7c1-5ef986d220a2 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Refreshing instance network info cache due to event network-changed-244d52f0-0501-41f0-ae45-147f1c9f504a. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b06f47d7-d8d3-42ab-9627-573f1b35a007 req-2cb0ca8f-81f6-40c7-b7c1-5ef986d220a2 service nova] Acquiring lock "refresh_cache-3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:01:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Updating instance_info_cache with network_info: [{"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Releasing lock "refresh_cache-3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Instance network_info: |[{"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b06f47d7-d8d3-42ab-9627-573f1b35a007 req-2cb0ca8f-81f6-40c7-b7c1-5ef986d220a2 service nova] Acquired lock "refresh_cache-3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-b06f47d7-d8d3-42ab-9627-573f1b35a007 req-2cb0ca8f-81f6-40c7-b7c1-5ef986d220a2 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Refreshing network info cache for port 244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Start _get_guest_xml network_info=[{"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'ff07f7e9-c859-41fd-adb3-c436d43c7526'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:45 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:01:45 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T01:25:35Z,direct_url=<?>,disk_format='qcow2',id=ff07f7e9-c859-41fd-adb3-c436d43c7526,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='344833b5ce954972baeb0fb8e706174f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T01:25:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1282405401',display_name='tempest-ServersNegativeTestJSON-server-1282405401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1282405401',id=46,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd080e37617456483a3f83f48d5811e',ramdisk_id='',reservation_id='r-lks809uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1091055269',owner_user_name='tempest-ServersNegativeTestJSON-1091055269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:01:43Z,user_data=None,user_id='faa7793f9ad2446eb57cc512a1972c07',uuid=3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converting VIF {"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=244d52f0-0501-41f0-ae45-147f1c9f504a,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244d52f0-05') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:01:45 user nova-compute[75215]:   <uuid>3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61</uuid>
Nov 11 02:01:45 user nova-compute[75215]:   <name>instance-0000002e</name>
Nov 11 02:01:45 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:01:45 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:01:45 user nova-compute[75215]:   <metadata>
Nov 11 02:01:45 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:01:45 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:01:45 user nova-compute[75215]:       <nova:name>tempest-ServersNegativeTestJSON-server-1282405401</nova:name>
Nov 11 02:01:45 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:01:45</nova:creationTime>
Nov 11 02:01:45 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:01:45 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:01:45 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:01:45 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:01:45 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:01:45 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:01:45 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:01:45 user nova-compute[75215]:       <nova:owner>
Nov 11 02:01:45 user nova-compute[75215]:         <nova:user uuid="faa7793f9ad2446eb57cc512a1972c07">tempest-ServersNegativeTestJSON-1091055269-project-member</nova:user>
Nov 11 02:01:45 user nova-compute[75215]:         <nova:project uuid="bfd080e37617456483a3f83f48d5811e">tempest-ServersNegativeTestJSON-1091055269</nova:project>
Nov 11 02:01:45 user nova-compute[75215]:       </nova:owner>
Nov 11 02:01:45 user nova-compute[75215]:       <nova:root type="image" uuid="ff07f7e9-c859-41fd-adb3-c436d43c7526"/>
Nov 11 02:01:45 user nova-compute[75215]:       <nova:ports>
Nov 11 02:01:45 user nova-compute[75215]:         <nova:port uuid="244d52f0-0501-41f0-ae45-147f1c9f504a">
Nov 11 02:01:45 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 02:01:45 user nova-compute[75215]:         </nova:port>
Nov 11 02:01:45 user nova-compute[75215]:       </nova:ports>
Nov 11 02:01:45 user nova-compute[75215]:     </nova:instance>
Nov 11 02:01:45 user nova-compute[75215]:   </metadata>
Nov 11 02:01:45 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:01:45 user nova-compute[75215]:     <system>
Nov 11 02:01:45 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:01:45 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:01:45 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:01:45 user nova-compute[75215]:       <entry name="serial">3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61</entry>
Nov 11 02:01:45 user nova-compute[75215]:       <entry name="uuid">3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61</entry>
Nov 11 02:01:45 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:01:45 user nova-compute[75215]:     </system>
Nov 11 02:01:45 user nova-compute[75215]:   </sysinfo>
Nov 11 02:01:45 user nova-compute[75215]:   <os>
Nov 11 02:01:45 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:01:45 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:01:45 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:01:45 user nova-compute[75215]:   </os>
Nov 11 02:01:45 user nova-compute[75215]:   <features>
Nov 11 02:01:45 user nova-compute[75215]:     <acpi/>
Nov 11 02:01:45 user nova-compute[75215]:     <apic/>
Nov 11 02:01:45 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:01:45 user nova-compute[75215]:   </features>
Nov 11 02:01:45 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:01:45 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:01:45 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:01:45 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:01:45 user nova-compute[75215]:   </clock>
Nov 11 02:01:45 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:01:45 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:01:45 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:01:45 user nova-compute[75215]:   </cpu>
Nov 11 02:01:45 user nova-compute[75215]:   <devices>
Nov 11 02:01:45 user nova-compute[75215]:     <disk type="file" device="disk">
Nov 11 02:01:45 user nova-compute[75215]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 02:01:45 user nova-compute[75215]:       <source file="/opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk"/>
Nov 11 02:01:45 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:01:45 user nova-compute[75215]:     </disk>
Nov 11 02:01:45 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:01:45 user nova-compute[75215]:       <mac address="fa:16:3e:d5:7c:08"/>
Nov 11 02:01:45 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:01:45 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:01:45 user nova-compute[75215]:       <target dev="tap244d52f0-05"/>
Nov 11 02:01:45 user nova-compute[75215]:     </interface>
Nov 11 02:01:45 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:01:45 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/console.log" append="off"/>
Nov 11 02:01:45 user nova-compute[75215]:     </serial>
Nov 11 02:01:45 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:01:45 user nova-compute[75215]:     <video>
Nov 11 02:01:45 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:01:45 user nova-compute[75215]:     </video>
Nov 11 02:01:45 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:01:45 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:01:45 user nova-compute[75215]:     </rng>
Nov 11 02:01:45 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:01:45 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:01:45 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:01:45 user nova-compute[75215]:     </memballoon>
Nov 11 02:01:45 user nova-compute[75215]:   </devices>
Nov 11 02:01:45 user nova-compute[75215]: </domain>
Nov 11 02:01:45 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1282405401',display_name='tempest-ServersNegativeTestJSON-server-1282405401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1282405401',id=46,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd080e37617456483a3f83f48d5811e',ramdisk_id='',reservation_id='r-lks809uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1091055269',owner_user_name='tempest-ServersNegativeTestJSON-1091055269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:01:43Z,user_data=None,user_id='faa7793f9ad2446eb57cc512a1972c07',uuid=3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converting VIF {"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=244d52f0-0501-41f0-ae45-147f1c9f504a,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244d52f0-05') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG os_vif [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=244d52f0-0501-41f0-ae45-147f1c9f504a,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244d52f0-05') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebfa94f3-c4b7-5a25-9ea6-020abbd85400', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap244d52f0-05, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap244d52f0-05, col_values=(('qos', UUID('2afb1aab-fcff-4065-86aa-252731773eb3')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap244d52f0-05, col_values=(('external_ids', {'iface-id': '244d52f0-0501-41f0-ae45-147f1c9f504a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:7c:08', 'vm-uuid': '3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:45 user nova-compute[75215]: INFO os_vif [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=244d52f0-0501-41f0-ae45-147f1c9f504a,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244d52f0-05')
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] No VIF found with MAC fa:16:3e:d5:7c:08, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-b06f47d7-d8d3-42ab-9627-573f1b35a007 req-2cb0ca8f-81f6-40c7-b7c1-5ef986d220a2 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Updated VIF entry in instance network info cache for port 244d52f0-0501-41f0-ae45-147f1c9f504a. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-b06f47d7-d8d3-42ab-9627-573f1b35a007 req-2cb0ca8f-81f6-40c7-b7c1-5ef986d220a2 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Updating instance_info_cache with network_info: [{"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:01:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b06f47d7-d8d3-42ab-9627-573f1b35a007 req-2cb0ca8f-81f6-40c7-b7c1-5ef986d220a2 service nova] Releasing lock "refresh_cache-3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:01:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-98c0cc46-94e9-4d64-bb81-07b13853133a req-d64042ed-d173-4ba9-ae00-e059ac080b3e service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received event network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:01:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98c0cc46-94e9-4d64-bb81-07b13853133a req-d64042ed-d173-4ba9-ae00-e059ac080b3e service nova] Acquiring lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98c0cc46-94e9-4d64-bb81-07b13853133a req-d64042ed-d173-4ba9-ae00-e059ac080b3e service nova] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-98c0cc46-94e9-4d64-bb81-07b13853133a req-d64042ed-d173-4ba9-ae00-e059ac080b3e service nova] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-98c0cc46-94e9-4d64-bb81-07b13853133a req-d64042ed-d173-4ba9-ae00-e059ac080b3e service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] No waiting events found dispatching network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:01:47 user nova-compute[75215]: WARNING nova.compute.manager [req-98c0cc46-94e9-4d64-bb81-07b13853133a req-d64042ed-d173-4ba9-ae00-e059ac080b3e service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received unexpected event network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a for instance with vm_state building and task_state spawning.
Nov 11 02:01:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-26849bdd-8916-49b0-89e5-f4153b5eff01 req-d81f8798-0e84-49bb-8368-b9672dd17cab service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received event network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-26849bdd-8916-49b0-89e5-f4153b5eff01 req-d81f8798-0e84-49bb-8368-b9672dd17cab service nova] Acquiring lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-26849bdd-8916-49b0-89e5-f4153b5eff01 req-d81f8798-0e84-49bb-8368-b9672dd17cab service nova] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-26849bdd-8916-49b0-89e5-f4153b5eff01 req-d81f8798-0e84-49bb-8368-b9672dd17cab service nova] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-26849bdd-8916-49b0-89e5-f4153b5eff01 req-d81f8798-0e84-49bb-8368-b9672dd17cab service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] No waiting events found dispatching network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:01:49 user nova-compute[75215]: WARNING nova.compute.manager [req-26849bdd-8916-49b0-89e5-f4153b5eff01 req-d81f8798-0e84-49bb-8368-b9672dd17cab service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received unexpected event network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a for instance with vm_state building and task_state spawning.
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:01:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Instance spawned successfully.
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:01:49 user nova-compute[75215]: INFO nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 11 02:01:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:01:49 user nova-compute[75215]: INFO nova.compute.manager [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Took 6.72 seconds to build instance.
Nov 11 02:01:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-62968607-65fb-4d3a-8ed2-b02e60a63169 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.834s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:01:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:01:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:01:57 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0cfc863d-7a90-4cc7-8127-206b85037b16 is timed out.
Nov 11 02:01:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Successfully detached device vdb from instance 0cfc863d-7a90-4cc7-8127-206b85037b16 from the live domain config.
Nov 11 02:01:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGPTMsBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:01:58 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ccc3ba-00d5-4fb8-9ee6-f10cc5158e4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:01:58 user nova-compute[75215]: No targets found.
Nov 11 02:01:58 user nova-compute[75215]: iSNS:
Nov 11 02:01:58 user nova-compute[75215]: No targets found.
Nov 11 02:01:58 user nova-compute[75215]: STATIC:
Nov 11 02:01:58 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d
Nov 11 02:01:58 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:01:58 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:01:58 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c
Nov 11 02:01:58 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:01:58 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:01:58 user nova-compute[75215]: FIRMWARE:
Nov 11 02:01:58 user nova-compute[75215]: No targets found.
Nov 11 02:01:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:01:58 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:01:58 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[16235716-79c8-43b2-8559-83b0484bcde4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d62b77-66a8-4a40-8b2b-7724cec2a2fe]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:01:58 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c (non-flash)
Nov 11 02:01:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:01:58 user nova-compute[75215]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c (non-flash)
Nov 11 02:01:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40444f3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ce79e-58c0-4483-b174-cbbeb44a9acd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f0d700-3496-4e8a-8719-65aa981fd9ba]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc3651-c46e-4b6e-be20-7b071839b1eb]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf7162b-be85-41e9-b5b1-931f504656f1]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0418e7a6-7433-4fcf-bf81-ae790aa930d7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3df5bd-1676-4b94-9524-874173af8bd2]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c, portal: 172.16.0.220,3260]
Nov 11 02:01:58 user nova-compute[75215]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c, portal: 172.16.0.220,3260] successful.
Nov 11 02:01:58 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c0c50b-8e40-4b03-956f-9bfdb9480f6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d16c2a-255b-4fd7-994b-2b6d66821cc7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] <== disconnect_volume: return (321ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:01:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:01:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'flavor' on Instance uuid 0cfc863d-7a90-4cc7-8127-206b85037b16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:01:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f35e2451-ef14-4e25-9ab6-4c9eab58eab1 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.940s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:02:03 user nova-compute[75215]: INFO nova.compute.claims [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Claim successful on node user
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 02:02:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 02:02:03 user nova-compute[75215]: INFO nova.virt.block_device [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Booting with volume a080488a-4a20-444c-99e0-4163f689692e at /dev/vda
Nov 11 02:02:03 user nova-compute[75215]: DEBUG nova.policy [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '195d763c024c4db99be056d17d243171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5a366788b744f9b121b9e946ff230f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG os_brick.utils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[60359ce9-d20d-464f-8c26-430ec32e9c0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[056363c5-78bd-428f-bafc-48f7a8741568]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b011f99-0a40-4413-9549-43c2c18136e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f00fd8-746f-4e21-a31b-2fe43d867046]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:02:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:02:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:02:04 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:02:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[111dead1-9b5b-41bf-97a3-629857ea1e33]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:02:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:02:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:02:04 user nova-compute[75215]: DEBUG os_brick.utils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:02:04 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updating existing volume attachment record: 3288a060-b1eb-4e4f-a2e3-f44efbdc3260 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:02:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Successfully created port: 257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Successfully updated port: 257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquired lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e555ecd0-45e4-4c64-9ebe-d9c989aa1de4 req-ec4df98c-2c80-4e7c-baed-36d015d5b9c7 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received event network-changed-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e555ecd0-45e4-4c64-9ebe-d9c989aa1de4 req-ec4df98c-2c80-4e7c-baed-36d015d5b9c7 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Refreshing instance network info cache due to event network-changed-257f8f7a-a8b9-41fc-9410-1f6857a86f73. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e555ecd0-45e4-4c64-9ebe-d9c989aa1de4 req-ec4df98c-2c80-4e7c-baed-36d015d5b9c7 service nova] Acquiring lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updating instance_info_cache with network_info: [{"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Releasing lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Instance network_info: |[{"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e555ecd0-45e4-4c64-9ebe-d9c989aa1de4 req-ec4df98c-2c80-4e7c-baed-36d015d5b9c7 service nova] Acquired lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:02:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-e555ecd0-45e4-4c64-9ebe-d9c989aa1de4 req-ec4df98c-2c80-4e7c-baed-36d015d5b9c7 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Refreshing network info cache for port 257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:02:06 user nova-compute[75215]: DEBUG nova.network.neutron [req-e555ecd0-45e4-4c64-9ebe-d9c989aa1de4 req-ec4df98c-2c80-4e7c-baed-36d015d5b9c7 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updated VIF entry in instance network info cache for port 257f8f7a-a8b9-41fc-9410-1f6857a86f73. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:02:06 user nova-compute[75215]: DEBUG nova.network.neutron [req-e555ecd0-45e4-4c64-9ebe-d9c989aa1de4 req-ec4df98c-2c80-4e7c-baed-36d015d5b9c7 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updating instance_info_cache with network_info: [{"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:02:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e555ecd0-45e4-4c64-9ebe-d9c989aa1de4 req-ec4df98c-2c80-4e7c-baed-36d015d5b9c7 service nova] Releasing lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:02:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-d044eb80-d026-4602-8821-b2f75eb5ea78 req-022faf19-c3c8-4158-a181-0c82f516708b service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-changed-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-d044eb80-d026-4602-8821-b2f75eb5ea78 req-022faf19-c3c8-4158-a181-0c82f516708b service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Refreshing instance network info cache due to event network-changed-e911ca15-640f-43a1-8ba7-6ea574c12db2. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d044eb80-d026-4602-8821-b2f75eb5ea78 req-022faf19-c3c8-4158-a181-0c82f516708b service nova] Acquiring lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d044eb80-d026-4602-8821-b2f75eb5ea78 req-022faf19-c3c8-4158-a181-0c82f516708b service nova] Acquired lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.network.neutron [req-d044eb80-d026-4602-8821-b2f75eb5ea78 req-022faf19-c3c8-4158-a181-0c82f516708b service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Refreshing network info cache for port e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:02:28 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Creating image(s)
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Ensure instance console log exists: /opt/stack/data/nova/instances/2d5bf74a-2b67-4210-b3df-709f11ca6799/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Start _get_guest_xml network_info=[{"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '3288a060-b1eb-4e4f-a2e3-f44efbdc3260', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBFuiYJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2d5bf74a-2b67-4210-b3df-709f11ca6799', 'attached_at': '', 'detached_at': '', 'volume_id': 'a080488a-4a20-444c-99e0-4163f689692e', 'serial': 'a080488a-4a20-444c-99e0-4163f689692e'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:28 user nova-compute[75215]: INFO nova.compute.manager [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Terminating instance
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.compute.manager [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:02:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:02:28 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBFuiYJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:02:28 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:02:28 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:02:28 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c28eab0-fc41-4b48-9e3a-7c049c8e02fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:02:28 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[018f9bf4-8dc7-498e-a5d2-56f7997c1b29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e] added
Nov 11 02:02:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e759188-3951-48aa-b577-5d88c99a2306]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a15c209-bced-4ada-b8bb-27dd7cadd521]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBFuiYJl {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBFuiYJl" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a3a72d-4b58-4c45-9b80-09aaf25e579a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jBFuiYJl'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345b83e-8048-494e-bbac-c4a90aa1f707]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8556493-2a05-4540-a078-d98cb58749b0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:02:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:02:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8a2040-fca8-4e89-a07e-2cec3dba8001]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e, portal: 172.16.0.220,3260]
Nov 11 02:02:28 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e, portal: 172.16.0.220,3260] successful.
Nov 11 02:02:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0f6851-8d23-49e3-b41b-84eeef857b29]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb333b9-eeb2-4db8-a0e0-121924173158]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:02:28 user nova-compute[75215]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:02:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:02:28 user nova-compute[75215]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:02:28 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[28040483-0ba4-4535-b4ac-7b5945cfe51a]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBFuiYJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-7479c66f-f46f-4a90-855e-56d3b8106a80 req-3c2631c2-6853-44bf-abfa-73bb193f7c0e service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-vif-unplugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7479c66f-f46f-4a90-855e-56d3b8106a80 req-3c2631c2-6853-44bf-abfa-73bb193f7c0e service nova] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7479c66f-f46f-4a90-855e-56d3b8106a80 req-3c2631c2-6853-44bf-abfa-73bb193f7c0e service nova] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7479c66f-f46f-4a90-855e-56d3b8106a80 req-3c2631c2-6853-44bf-abfa-73bb193f7c0e service nova] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-7479c66f-f46f-4a90-855e-56d3b8106a80 req-3c2631c2-6853-44bf-abfa-73bb193f7c0e service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] No waiting events found dispatching network-vif-unplugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:02:28 user nova-compute[75215]: DEBUG nova.compute.manager [req-7479c66f-f46f-4a90-855e-56d3b8106a80 req-3c2631c2-6853-44bf-abfa-73bb193f7c0e service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-vif-unplugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-d044eb80-d026-4602-8821-b2f75eb5ea78 req-022faf19-c3c8-4158-a181-0c82f516708b service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updated VIF entry in instance network info cache for port e911ca15-640f-43a1-8ba7-6ea574c12db2. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-d044eb80-d026-4602-8821-b2f75eb5ea78 req-022faf19-c3c8-4158-a181-0c82f516708b service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updating instance_info_cache with network_info: [{"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d044eb80-d026-4602-8821-b2f75eb5ea78 req-022faf19-c3c8-4158-a181-0c82f516708b service nova] Releasing lock "refresh_cache-0cfc863d-7a90-4cc7-8127-206b85037b16" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:02:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Instance destroyed successfully.
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'resources' on Instance uuid 0cfc863d-7a90-4cc7-8127-206b85037b16 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-510078255',display_name='tempest-TestStampPattern-server-510078255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-510078255',id=43,image_ref='4e214719-247b-43b7-8ada-1ed3c6f38a44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcw1WLcxHGrUZgRTLCyIgVsmMR4VUkGy9pjePScYuTXptsl6Clt/SyEY1h7Lk3D1TqiG4jkLE2ejH3fjVoqyLMcQCmiWHmrdAKLKNMXdQfBFqk3/YOam91kBTpZJVrp1Q==',key_name='tempest-TestStampPattern-1661226900',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6fe9e1a46ae4d54973aad68cd3e0816',ramdisk_id='',reservation_id='r-c6dcf59f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9b03800-0532-446a-b985-1507e3b4db3e',image_min_disk='1',image_min_ram='0',image_owner_id='a6fe9e1a46ae4d54973aad68cd3e0816',image_owner_project_name='tempest-TestStampPattern-1920847764',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1920847764-project-member',image_user_id='a486927bdc474540820f23ffb8758d45',owner_project_name='tempest-TestStampPattern-1920847764',owner_user_name='tempest-TestStampPattern-1920847764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:59:23Z,user_data=None,user_id='a486927bdc474540820f23ffb8758d45',uuid=0cfc863d-7a90-4cc7-8127-206b85037b16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converting VIF {"id": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "address": "fa:16:3e:09:81:f8", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape911ca15-64", "ovs_interfaceid": "e911ca15-640f-43a1-8ba7-6ea574c12db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:81:f8,bridge_name='br-int',has_traffic_filtering=True,id=e911ca15-640f-43a1-8ba7-6ea574c12db2,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape911ca15-64') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG os_vif [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:81:f8,bridge_name='br-int',has_traffic_filtering=True,id=e911ca15-640f-43a1-8ba7-6ea574c12db2,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape911ca15-64') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape911ca15-64, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5b99240-0f94-4250-b656-d11db8ccab19) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:02:29 user nova-compute[75215]: INFO os_vif [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:81:f8,bridge_name='br-int',has_traffic_filtering=True,id=e911ca15-640f-43a1-8ba7-6ea574c12db2,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape911ca15-64')
Nov 11 02:02:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Deleting instance files /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16_del
Nov 11 02:02:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Deletion of /opt/stack/data/nova/instances/0cfc863d-7a90-4cc7-8127-206b85037b16_del complete
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: INFO nova.compute.manager [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 11 02:02:29 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23133396563373862', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133396563373862', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:02:29 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Took 0.47 seconds to deallocate network for instance.
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-200025765',display_name='tempest-TestVolumeBootPattern-volume-backed-server-200025765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-200025765',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELR0acTfIlG5bET4VSAT21jITEMov+pRn8JenOPCqHN2afbMsp55CP9Qe5a1l9wHD7YGzG9fpr4D2D1EOGooJVyR2kNex3R9mOIiG7vRo6qJO/zYWBWE/tqfv7QyOgLDw==',key_name='tempest-keypair-489132160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-udh2fm70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195d763c024c4db99be056d17d243171',uuid=2d5bf74a-2b67-4210-b3df-709f11ca6799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:51,bridge_name='br-int',has_traffic_filtering=True,id=257f8f7a-a8b9-41fc-9410-1f6857a86f73,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257f8f7a-a8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d5bf74a-2b67-4210-b3df-709f11ca6799 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:02:29 user nova-compute[75215]:   <uuid>2d5bf74a-2b67-4210-b3df-709f11ca6799</uuid>
Nov 11 02:02:29 user nova-compute[75215]:   <name>instance-0000002f</name>
Nov 11 02:02:29 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:02:29 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:02:29 user nova-compute[75215]:   <metadata>
Nov 11 02:02:29 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:02:29 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:02:29 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-200025765</nova:name>
Nov 11 02:02:29 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:02:28</nova:creationTime>
Nov 11 02:02:29 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:02:29 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:02:29 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:02:29 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:02:29 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:02:29 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:02:29 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:02:29 user nova-compute[75215]:       <nova:owner>
Nov 11 02:02:29 user nova-compute[75215]:         <nova:user uuid="195d763c024c4db99be056d17d243171">tempest-TestVolumeBootPattern-1487726842-project-member</nova:user>
Nov 11 02:02:29 user nova-compute[75215]:         <nova:project uuid="ca5a366788b744f9b121b9e946ff230f">tempest-TestVolumeBootPattern-1487726842</nova:project>
Nov 11 02:02:29 user nova-compute[75215]:       </nova:owner>
Nov 11 02:02:29 user nova-compute[75215]:       <nova:ports>
Nov 11 02:02:29 user nova-compute[75215]:         <nova:port uuid="257f8f7a-a8b9-41fc-9410-1f6857a86f73">
Nov 11 02:02:29 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 11 02:02:29 user nova-compute[75215]:         </nova:port>
Nov 11 02:02:29 user nova-compute[75215]:       </nova:ports>
Nov 11 02:02:29 user nova-compute[75215]:     </nova:instance>
Nov 11 02:02:29 user nova-compute[75215]:   </metadata>
Nov 11 02:02:29 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:02:29 user nova-compute[75215]:     <system>
Nov 11 02:02:29 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:02:29 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:02:29 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:02:29 user nova-compute[75215]:       <entry name="serial">2d5bf74a-2b67-4210-b3df-709f11ca6799</entry>
Nov 11 02:02:29 user nova-compute[75215]:       <entry name="uuid">2d5bf74a-2b67-4210-b3df-709f11ca6799</entry>
Nov 11 02:02:29 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:02:29 user nova-compute[75215]:     </system>
Nov 11 02:02:29 user nova-compute[75215]:   </sysinfo>
Nov 11 02:02:29 user nova-compute[75215]:   <os>
Nov 11 02:02:29 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:02:29 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:02:29 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:02:29 user nova-compute[75215]:   </os>
Nov 11 02:02:29 user nova-compute[75215]:   <features>
Nov 11 02:02:29 user nova-compute[75215]:     <acpi/>
Nov 11 02:02:29 user nova-compute[75215]:     <apic/>
Nov 11 02:02:29 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:02:29 user nova-compute[75215]:   </features>
Nov 11 02:02:29 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:02:29 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:02:29 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:02:29 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:02:29 user nova-compute[75215]:   </clock>
Nov 11 02:02:29 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:02:29 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:02:29 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:02:29 user nova-compute[75215]:   </cpu>
Nov 11 02:02:29 user nova-compute[75215]:   <devices>
Nov 11 02:02:29 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 02:02:29 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:02:29 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 11 02:02:29 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:02:29 user nova-compute[75215]:       <serial>a080488a-4a20-444c-99e0-4163f689692e</serial>
Nov 11 02:02:29 user nova-compute[75215]:     </disk>
Nov 11 02:02:29 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:02:29 user nova-compute[75215]:       <mac address="fa:16:3e:10:18:51"/>
Nov 11 02:02:29 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:02:29 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:02:29 user nova-compute[75215]:       <target dev="tap257f8f7a-a8"/>
Nov 11 02:02:29 user nova-compute[75215]:     </interface>
Nov 11 02:02:29 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:02:29 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/2d5bf74a-2b67-4210-b3df-709f11ca6799/console.log" append="off"/>
Nov 11 02:02:29 user nova-compute[75215]:     </serial>
Nov 11 02:02:29 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:02:29 user nova-compute[75215]:     <video>
Nov 11 02:02:29 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:02:29 user nova-compute[75215]:     </video>
Nov 11 02:02:29 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:02:29 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:02:29 user nova-compute[75215]:     </rng>
Nov 11 02:02:29 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:02:29 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:02:29 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:02:29 user nova-compute[75215]:     </memballoon>
Nov 11 02:02:29 user nova-compute[75215]:   </devices>
Nov 11 02:02:29 user nova-compute[75215]: </domain>
Nov 11 02:02:29 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-200025765',display_name='tempest-TestVolumeBootPattern-volume-backed-server-200025765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-200025765',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELR0acTfIlG5bET4VSAT21jITEMov+pRn8JenOPCqHN2afbMsp55CP9Qe5a1l9wHD7YGzG9fpr4D2D1EOGooJVyR2kNex3R9mOIiG7vRo6qJO/zYWBWE/tqfv7QyOgLDw==',key_name='tempest-keypair-489132160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-udh2fm70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195d763c024c4db99be056d17d243171',uuid=2d5bf74a-2b67-4210-b3df-709f11ca6799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:51,bridge_name='br-int',has_traffic_filtering=True,id=257f8f7a-a8b9-41fc-9410-1f6857a86f73,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257f8f7a-a8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG os_vif [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:51,bridge_name='br-int',has_traffic_filtering=True,id=257f8f7a-a8b9-41fc-9410-1f6857a86f73,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257f8f7a-a8') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de3b1950-69b9-5572-8c7d-4f21dfebe357', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap257f8f7a-a8, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap257f8f7a-a8, col_values=(('qos', UUID('e6d2a477-19b2-4e01-a4c4-b84a0df4dcd6')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap257f8f7a-a8, col_values=(('external_ids', {'iface-id': '257f8f7a-a8b9-41fc-9410-1f6857a86f73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:18:51', 'vm-uuid': '2d5bf74a-2b67-4210-b3df-709f11ca6799'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:29 user nova-compute[75215]: INFO os_vif [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:18:51,bridge_name='br-int',has_traffic_filtering=True,id=257f8f7a-a8b9-41fc-9410-1f6857a86f73,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257f8f7a-a8')
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No VIF found with MAC fa:16:3e:10:18:51, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:02:29 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:30 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Deleted allocations for instance 0cfc863d-7a90-4cc7-8127-206b85037b16
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-97cc77a1-af39-4fc1-8693-12def39659c5 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.869s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-cd94958e-0ee2-48af-856a-f29f40cfdd7d req-8f626610-57bf-425f-8580-d000274a1759 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd94958e-0ee2-48af-856a-f29f40cfdd7d req-8f626610-57bf-425f-8580-d000274a1759 service nova] Acquiring lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd94958e-0ee2-48af-856a-f29f40cfdd7d req-8f626610-57bf-425f-8580-d000274a1759 service nova] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cd94958e-0ee2-48af-856a-f29f40cfdd7d req-8f626610-57bf-425f-8580-d000274a1759 service nova] Lock "0cfc863d-7a90-4cc7-8127-206b85037b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-cd94958e-0ee2-48af-856a-f29f40cfdd7d req-8f626610-57bf-425f-8580-d000274a1759 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] No waiting events found dispatching network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:02:30 user nova-compute[75215]: WARNING nova.compute.manager [req-cd94958e-0ee2-48af-856a-f29f40cfdd7d req-8f626610-57bf-425f-8580-d000274a1759 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received unexpected event network-vif-plugged-e911ca15-640f-43a1-8ba7-6ea574c12db2 for instance with vm_state deleted and task_state None.
Nov 11 02:02:30 user nova-compute[75215]: DEBUG nova.compute.manager [req-cd94958e-0ee2-48af-856a-f29f40cfdd7d req-8f626610-57bf-425f-8580-d000274a1759 service nova] [instance: 0cfc863d-7a90-4cc7-8127-206b85037b16] Received event network-vif-deleted-e911ca15-640f-43a1-8ba7-6ea574c12db2 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received event network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] Acquiring lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] No waiting events found dispatching network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:02:32 user nova-compute[75215]: WARNING nova.compute.manager [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received unexpected event network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 for instance with vm_state building and task_state spawning.
Nov 11 02:02:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received event network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] Acquiring lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] No waiting events found dispatching network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:02:32 user nova-compute[75215]: WARNING nova.compute.manager [req-cf2d565a-bd44-4cd8-9bee-13598c52eca5 req-6e2a4909-1f8e-4c1c-b8a3-f37ec5379f6b service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received unexpected event network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 for instance with vm_state building and task_state spawning.
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:02:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Instance spawned successfully.
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:02:33 user nova-compute[75215]: INFO nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:33 user nova-compute[75215]: INFO nova.compute.manager [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Took 30.33 seconds to build instance.
Nov 11 02:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-741a7cb7-bd30-4006-bdae-7e231d8ee296 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.457s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:02:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:02:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:02:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:02:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8203MB free_disk=24.912975311279297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 905d9e3a-da73-49a4-8548-81512b37fb86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6696ee6b-11f3-45b1-b023-558ab78db2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2d5bf74a-2b67-4210-b3df-709f11ca6799 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:02:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:02:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-f733ed3c-3506-4985-95c8-ce6752601ebe req-9e59d786-d506-4c14-b027-18ea2caf68c5 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-f733ed3c-3506-4985-95c8-ce6752601ebe req-9e59d786-d506-4c14-b027-18ea2caf68c5 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing instance network info cache due to event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f733ed3c-3506-4985-95c8-ce6752601ebe req-9e59d786-d506-4c14-b027-18ea2caf68c5 service nova] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:02:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f733ed3c-3506-4985-95c8-ce6752601ebe req-9e59d786-d506-4c14-b027-18ea2caf68c5 service nova] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:02:41 user nova-compute[75215]: DEBUG nova.network.neutron [req-f733ed3c-3506-4985-95c8-ce6752601ebe req-9e59d786-d506-4c14-b027-18ea2caf68c5 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-f733ed3c-3506-4985-95c8-ce6752601ebe req-9e59d786-d506-4c14-b027-18ea2caf68c5 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updated VIF entry in instance network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-f733ed3c-3506-4985-95c8-ce6752601ebe req-9e59d786-d506-4c14-b027-18ea2caf68c5 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f733ed3c-3506-4985-95c8-ce6752601ebe req-9e59d786-d506-4c14-b027-18ea2caf68c5 service nova] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-d578b256-7ef0-4a66-b941-d295983ed298 req-458bae26-02e2-4e37-818d-0475d24c8ba1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.compute.manager [req-d578b256-7ef0-4a66-b941-d295983ed298 req-458bae26-02e2-4e37-818d-0475d24c8ba1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing instance network info cache due to event network-changed-8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d578b256-7ef0-4a66-b941-d295983ed298 req-458bae26-02e2-4e37-818d-0475d24c8ba1 service nova] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d578b256-7ef0-4a66-b941-d295983ed298 req-458bae26-02e2-4e37-818d-0475d24c8ba1 service nova] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.network.neutron [req-d578b256-7ef0-4a66-b941-d295983ed298 req-458bae26-02e2-4e37-818d-0475d24c8ba1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Refreshing network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:02:42 user nova-compute[75215]: INFO nova.compute.manager [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Detaching volume 5c8f33bd-7a20-4ab3-ae53-842f25ecd41d
Nov 11 02:02:42 user nova-compute[75215]: INFO nova.virt.block_device [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Attempting to driver detach volume 5c8f33bd-7a20-4ab3-ae53-842f25ecd41d from mountpoint /dev/vdb
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Attempting to detach device vdb from instance 905d9e3a-da73-49a4-8548-81512b37fb86 from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 02:02:42 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:02:42 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 02:02:42 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:02:42 user nova-compute[75215]:   <serial>5c8f33bd-7a20-4ab3-ae53-842f25ecd41d</serial>
Nov 11 02:02:42 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 02:02:42 user nova-compute[75215]: </disk>
Nov 11 02:02:42 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 02:02:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully detached device vdb from instance 905d9e3a-da73-49a4-8548-81512b37fb86 from the persistent domain config.
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 905d9e3a-da73-49a4-8548-81512b37fb86 from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 02:02:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 02:02:42 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:02:42 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 02:02:42 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:02:42 user nova-compute[75215]:   <serial>5c8f33bd-7a20-4ab3-ae53-842f25ecd41d</serial>
Nov 11 02:02:42 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 02:02:42 user nova-compute[75215]: </disk>
Nov 11 02:02:42 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 02:02:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-d578b256-7ef0-4a66-b941-d295983ed298 req-458bae26-02e2-4e37-818d-0475d24c8ba1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updated VIF entry in instance network info cache for port 8bd632f6-8b87-4591-99d1-d40b8571210f. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:02:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-d578b256-7ef0-4a66-b941-d295983ed298 req-458bae26-02e2-4e37-818d-0475d24c8ba1 service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:02:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d578b256-7ef0-4a66-b941-d295983ed298 req-458bae26-02e2-4e37-818d-0475d24c8ba1 service nova] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:02:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 905d9e3a-da73-49a4-8548-81512b37fb86 {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 02:02:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [{"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-905d9e3a-da73-49a4-8548-81512b37fb86" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:02:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:02:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:02:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 905d9e3a-da73-49a4-8548-81512b37fb86 is timed out.
Nov 11 02:03:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully detached device vdb from instance 905d9e3a-da73-49a4-8548-81512b37fb86 from the live domain config.
Nov 11 02:03:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlIydKvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:03:03 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3d727-8a9a-4289-9283-1668a613ccf1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:03:03 user nova-compute[75215]: No targets found.
Nov 11 02:03:03 user nova-compute[75215]: iSNS:
Nov 11 02:03:03 user nova-compute[75215]: No targets found.
Nov 11 02:03:03 user nova-compute[75215]: STATIC:
Nov 11 02:03:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e
Nov 11 02:03:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:03:03 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:03:03 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d
Nov 11 02:03:03 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:03:03 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:03:03 user nova-compute[75215]: FIRMWARE:
Nov 11 02:03:03 user nova-compute[75215]: No targets found.
Nov 11 02:03:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:03:03 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:03:03 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e26051-0e8c-4bc2-80b5-093e12abbbce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57a037-bfe7-445c-815a-b1b4cb25a6b4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:03:03 user nova-compute[75215]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:03:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d (non-flash)
Nov 11 02:03:03 user nova-compute[75215]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:03:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404421cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd468968-c120-4821-9709-dca5c61bb72e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90159a-39dd-44b8-92bc-09bca6037809]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b2ffae-a57b-4b27-8644-68f6a2093a76]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f67e84f-75c1-4303-bede-cd0a0bc9fffb]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab22134f-eae6-4661-99c3-f680f71426b7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[61814df1-7fcf-4458-b9a5-5a58d466287e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d, portal: 172.16.0.220,3260]
Nov 11 02:03:03 user nova-compute[75215]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d, portal: 172.16.0.220,3260] successful.
Nov 11 02:03:03 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c8f33bd-7a20-4ab3-ae53-842f25ecd41d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c81065-b44f-484b-b1d5-8fa11f7a04f2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] <== disconnect_volume: return (306ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:03:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:03:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'flavor' on Instance uuid 905d9e3a-da73-49a4-8548-81512b37fb86 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:03:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-96c23666-3154-4d16-89b2-bc5177d7215b tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.941s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:03:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-d1f67c8e-dbfc-4c89-a3a3-384592baa07c req-689857af-67d8-4f1e-9446-6beb22d4f338 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-changed-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG nova.compute.manager [req-d1f67c8e-dbfc-4c89-a3a3-384592baa07c req-689857af-67d8-4f1e-9446-6beb22d4f338 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Refreshing instance network info cache due to event network-changed-afa87a4b-a5f1-4503-82ef-137ba0083bc0. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d1f67c8e-dbfc-4c89-a3a3-384592baa07c req-689857af-67d8-4f1e-9446-6beb22d4f338 service nova] Acquiring lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d1f67c8e-dbfc-4c89-a3a3-384592baa07c req-689857af-67d8-4f1e-9446-6beb22d4f338 service nova] Acquired lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-d1f67c8e-dbfc-4c89-a3a3-384592baa07c req-689857af-67d8-4f1e-9446-6beb22d4f338 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Refreshing network info cache for port afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'flavor' on Instance uuid 6696ee6b-11f3-45b1-b023-558ab78db2fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:03:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Ignoring supplied device name: /dev/vdb
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:29 user nova-compute[75215]: INFO nova.compute.manager [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Attaching volume 133a5de2-af47-4cfc-a738-9409a015d89a to /dev/vdb
Nov 11 02:03:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-d1f67c8e-dbfc-4c89-a3a3-384592baa07c req-689857af-67d8-4f1e-9446-6beb22d4f338 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Updated VIF entry in instance network info cache for port afa87a4b-a5f1-4503-82ef-137ba0083bc0. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG nova.network.neutron [req-d1f67c8e-dbfc-4c89-a3a3-384592baa07c req-689857af-67d8-4f1e-9446-6beb22d4f338 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Updating instance_info_cache with network_info: [{"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d1f67c8e-dbfc-4c89-a3a3-384592baa07c req-689857af-67d8-4f1e-9446-6beb22d4f338 service nova] Releasing lock "refresh_cache-6696ee6b-11f3-45b1-b023-558ab78db2fd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG os_brick.utils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[581ee52d-fb8d-41f1-a068-794333e204d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18a8477-7ce0-4b40-9d3a-ffec8d2eefed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c1ca46-5d1e-42bb-81a9-4bef3052ff19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e0766d-ab29-4b83-8e0f-e836f835eb98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:03:29 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:03:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43dff1b-863c-424c-883c-ec87681502cd]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG os_brick.utils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Updating existing volume attachment record: 4ac719f3-a116-4cb2-af62-a0faf52cd595 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:03:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:30 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:31 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:32 user nova-compute[75215]: INFO nova.compute.manager [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Terminating instance
Nov 11 02:03:32 user nova-compute[75215]: DEBUG nova.compute.manager [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-e7a13691-11bc-460b-8e73-cb4a50ff8520 req-e5843e61-da8f-49e9-8731-0ed87acb115a service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received event network-vif-unplugged-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e7a13691-11bc-460b-8e73-cb4a50ff8520 req-e5843e61-da8f-49e9-8731-0ed87acb115a service nova] Acquiring lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e7a13691-11bc-460b-8e73-cb4a50ff8520 req-e5843e61-da8f-49e9-8731-0ed87acb115a service nova] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e7a13691-11bc-460b-8e73-cb4a50ff8520 req-e5843e61-da8f-49e9-8731-0ed87acb115a service nova] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-e7a13691-11bc-460b-8e73-cb4a50ff8520 req-e5843e61-da8f-49e9-8731-0ed87acb115a service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] No waiting events found dispatching network-vif-unplugged-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.manager [req-e7a13691-11bc-460b-8e73-cb4a50ff8520 req-e5843e61-da8f-49e9-8731-0ed87acb115a service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received event network-vif-unplugged-244d52f0-0501-41f0-ae45-147f1c9f504a for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:03:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:03:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8219MB free_disk=24.958873748779297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Instance destroyed successfully.
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.objects.instance [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lazy-loading 'resources' on Instance uuid 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1282405401',display_name='tempest-ServersNegativeTestJSON-server-1282405401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1282405401',id=46,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:01:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfd080e37617456483a3f83f48d5811e',ramdisk_id='',reservation_id='r-lks809uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1091055269',owner_user_name='tempest-ServersNegativeTestJSON-1091055269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:01:49Z,user_data=None,user_id='faa7793f9ad2446eb57cc512a1972c07',uuid=3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converting VIF {"id": "244d52f0-0501-41f0-ae45-147f1c9f504a", "address": "fa:16:3e:d5:7c:08", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244d52f0-05", "ovs_interfaceid": "244d52f0-0501-41f0-ae45-147f1c9f504a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=244d52f0-0501-41f0-ae45-147f1c9f504a,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244d52f0-05') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG os_vif [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=244d52f0-0501-41f0-ae45-147f1c9f504a,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244d52f0-05') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap244d52f0-05, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2afb1aab-fcff-4065-86aa-252731773eb3) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:03:33 user nova-compute[75215]: INFO os_vif [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=244d52f0-0501-41f0-ae45-147f1c9f504a,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244d52f0-05')
Nov 11 02:03:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Deleting instance files /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61_del
Nov 11 02:03:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Deletion of /opt/stack/data/nova/instances/3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61_del complete
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance c9b03800-0532-446a-b985-1507e3b4db3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 905d9e3a-da73-49a4-8548-81512b37fb86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6696ee6b-11f3-45b1-b023-558ab78db2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2d5bf74a-2b67-4210-b3df-709f11ca6799 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:03:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:03:34 user nova-compute[75215]: INFO nova.compute.manager [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 11 02:03:34 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:03:34 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Took 0.52 seconds to deallocate network for instance.
Nov 11 02:03:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:03:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:34 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Deleted allocations for instance 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61
Nov 11 02:03:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-c690b729-b920-4a27-88c1-d972d503da77 tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.397s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-96f2782f-94fc-4f0e-8265-cc433ceea137 req-adb1b821-c181-4468-8787-e92819b53c72 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received event network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-96f2782f-94fc-4f0e-8265-cc433ceea137 req-adb1b821-c181-4468-8787-e92819b53c72 service nova] Acquiring lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-96f2782f-94fc-4f0e-8265-cc433ceea137 req-adb1b821-c181-4468-8787-e92819b53c72 service nova] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-96f2782f-94fc-4f0e-8265-cc433ceea137 req-adb1b821-c181-4468-8787-e92819b53c72 service nova] Lock "3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-96f2782f-94fc-4f0e-8265-cc433ceea137 req-adb1b821-c181-4468-8787-e92819b53c72 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] No waiting events found dispatching network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:03:35 user nova-compute[75215]: WARNING nova.compute.manager [req-96f2782f-94fc-4f0e-8265-cc433ceea137 req-adb1b821-c181-4468-8787-e92819b53c72 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received unexpected event network-vif-plugged-244d52f0-0501-41f0-ae45-147f1c9f504a for instance with vm_state deleted and task_state None.
Nov 11 02:03:35 user nova-compute[75215]: DEBUG nova.compute.manager [req-96f2782f-94fc-4f0e-8265-cc433ceea137 req-adb1b821-c181-4468-8787-e92819b53c72 service nova] [instance: 3cf5d0a7-5cb9-42eb-81ef-e99bddf9af61] Received event network-vif-deleted-244d52f0-0501-41f0-ae45-147f1c9f504a {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updating instance_info_cache with network_info: [{"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-17bea499-5bd9-46b2-a10c-3494ed5673e0 req-0f3d889c-a283-4c7f-9af3-4398bc25d836 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-changed-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG nova.compute.manager [req-17bea499-5bd9-46b2-a10c-3494ed5673e0 req-0f3d889c-a283-4c7f-9af3-4398bc25d836 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Refreshing instance network info cache due to event network-changed-8959d9c4-7a5c-41a3-81db-d3d65bc87f57. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17bea499-5bd9-46b2-a10c-3494ed5673e0 req-0f3d889c-a283-4c7f-9af3-4398bc25d836 service nova] Acquiring lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17bea499-5bd9-46b2-a10c-3494ed5673e0 req-0f3d889c-a283-4c7f-9af3-4398bc25d836 service nova] Acquired lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:03:43 user nova-compute[75215]: DEBUG nova.network.neutron [req-17bea499-5bd9-46b2-a10c-3494ed5673e0 req-0f3d889c-a283-4c7f-9af3-4398bc25d836 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Refreshing network info cache for port 8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:44 user nova-compute[75215]: INFO nova.compute.manager [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Terminating instance
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb189503-91cb-438b-b697-cbd723286240 req-b41224a4-55e9-42af-a6be-cc77a38533d1 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-vif-unplugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb189503-91cb-438b-b697-cbd723286240 req-b41224a4-55e9-42af-a6be-cc77a38533d1 service nova] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb189503-91cb-438b-b697-cbd723286240 req-b41224a4-55e9-42af-a6be-cc77a38533d1 service nova] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fb189503-91cb-438b-b697-cbd723286240 req-b41224a4-55e9-42af-a6be-cc77a38533d1 service nova] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb189503-91cb-438b-b697-cbd723286240 req-b41224a4-55e9-42af-a6be-cc77a38533d1 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] No waiting events found dispatching network-vif-unplugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-fb189503-91cb-438b-b697-cbd723286240 req-b41224a4-55e9-42af-a6be-cc77a38533d1 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-vif-unplugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-17bea499-5bd9-46b2-a10c-3494ed5673e0 req-0f3d889c-a283-4c7f-9af3-4398bc25d836 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updated VIF entry in instance network info cache for port 8959d9c4-7a5c-41a3-81db-d3d65bc87f57. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-17bea499-5bd9-46b2-a10c-3494ed5673e0 req-0f3d889c-a283-4c7f-9af3-4398bc25d836 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updating instance_info_cache with network_info: [{"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-17bea499-5bd9-46b2-a10c-3494ed5673e0 req-0f3d889c-a283-4c7f-9af3-4398bc25d836 service nova] Releasing lock "refresh_cache-c9b03800-0532-446a-b985-1507e3b4db3e" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:03:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Instance destroyed successfully.
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lazy-loading 'resources' on Instance uuid c9b03800-0532-446a-b985-1507e3b4db3e {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1033493510',display_name='tempest-TestStampPattern-server-1033493510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1033493510',id=39,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcw1WLcxHGrUZgRTLCyIgVsmMR4VUkGy9pjePScYuTXptsl6Clt/SyEY1h7Lk3D1TqiG4jkLE2ejH3fjVoqyLMcQCmiWHmrdAKLKNMXdQfBFqk3/YOam91kBTpZJVrp1Q==',key_name='tempest-TestStampPattern-1661226900',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:55:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6fe9e1a46ae4d54973aad68cd3e0816',ramdisk_id='',reservation_id='r-te0s8jrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1920847764',owner_user_name='tempest-TestStampPattern-1920847764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:59:13Z,user_data=None,user_id='a486927bdc474540820f23ffb8758d45',uuid=c9b03800-0532-446a-b985-1507e3b4db3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converting VIF {"id": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "address": "fa:16:3e:c5:e7:0b", "network": {"id": "90b092c5-aa61-4e1a-84f0-3fa11756fbbb", "bridge": "br-int", "label": "tempest-TestStampPattern-926353876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe9e1a46ae4d54973aad68cd3e0816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8959d9c4-7a", "ovs_interfaceid": "8959d9c4-7a5c-41a3-81db-d3d65bc87f57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:e7:0b,bridge_name='br-int',has_traffic_filtering=True,id=8959d9c4-7a5c-41a3-81db-d3d65bc87f57,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8959d9c4-7a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG os_vif [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:e7:0b,bridge_name='br-int',has_traffic_filtering=True,id=8959d9c4-7a5c-41a3-81db-d3d65bc87f57,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8959d9c4-7a') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8959d9c4-7a, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44172088-d743-448f-9bda-122b5da5ea2c) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:03:44 user nova-compute[75215]: INFO os_vif [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:e7:0b,bridge_name='br-int',has_traffic_filtering=True,id=8959d9c4-7a5c-41a3-81db-d3d65bc87f57,network=Network(90b092c5-aa61-4e1a-84f0-3fa11756fbbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8959d9c4-7a')
Nov 11 02:03:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Deleting instance files /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e_del
Nov 11 02:03:44 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Deletion of /opt/stack/data/nova/instances/c9b03800-0532-446a-b985-1507e3b4db3e_del complete
Nov 11 02:03:44 user nova-compute[75215]: INFO nova.compute.manager [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 11 02:03:44 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:03:44 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:03:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:45 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:03:45 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Took 0.45 seconds to deallocate network for instance.
Nov 11 02:03:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:45 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:03:45 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:03:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:45 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Deleted allocations for instance c9b03800-0532-446a-b985-1507e3b4db3e
Nov 11 02:03:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf0fccde-1582-4cde-b0aa-47b119e10651 tempest-TestStampPattern-1920847764 tempest-TestStampPattern-1920847764-project-member] Lock "c9b03800-0532-446a-b985-1507e3b4db3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.719s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:46 user nova-compute[75215]: INFO nova.compute.manager [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Terminating instance
Nov 11 02:03:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-bbdd8233-b855-4af2-955a-436e93b6005c req-399949c0-cf60-4e05-8e7a-d90a5ad92e25 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bbdd8233-b855-4af2-955a-436e93b6005c req-399949c0-cf60-4e05-8e7a-d90a5ad92e25 service nova] Acquiring lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bbdd8233-b855-4af2-955a-436e93b6005c req-399949c0-cf60-4e05-8e7a-d90a5ad92e25 service nova] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bbdd8233-b855-4af2-955a-436e93b6005c req-399949c0-cf60-4e05-8e7a-d90a5ad92e25 service nova] Lock "c9b03800-0532-446a-b985-1507e3b4db3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-bbdd8233-b855-4af2-955a-436e93b6005c req-399949c0-cf60-4e05-8e7a-d90a5ad92e25 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] No waiting events found dispatching network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:03:46 user nova-compute[75215]: WARNING nova.compute.manager [req-bbdd8233-b855-4af2-955a-436e93b6005c req-399949c0-cf60-4e05-8e7a-d90a5ad92e25 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received unexpected event network-vif-plugged-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 for instance with vm_state deleted and task_state None.
Nov 11 02:03:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-bbdd8233-b855-4af2-955a-436e93b6005c req-399949c0-cf60-4e05-8e7a-d90a5ad92e25 service nova] [instance: c9b03800-0532-446a-b985-1507e3b4db3e] Received event network-vif-deleted-8959d9c4-7a5c-41a3-81db-d3d65bc87f57 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-88e6b42b-d6c3-431b-b806-7c75500fd0de req-9c9165ba-50c9-4018-be1b-f5f35f8a1eac service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-unplugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88e6b42b-d6c3-431b-b806-7c75500fd0de req-9c9165ba-50c9-4018-be1b-f5f35f8a1eac service nova] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88e6b42b-d6c3-431b-b806-7c75500fd0de req-9c9165ba-50c9-4018-be1b-f5f35f8a1eac service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-88e6b42b-d6c3-431b-b806-7c75500fd0de req-9c9165ba-50c9-4018-be1b-f5f35f8a1eac service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-88e6b42b-d6c3-431b-b806-7c75500fd0de req-9c9165ba-50c9-4018-be1b-f5f35f8a1eac service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] No waiting events found dispatching network-vif-unplugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:03:46 user nova-compute[75215]: DEBUG nova.compute.manager [req-88e6b42b-d6c3-431b-b806-7c75500fd0de req-9c9165ba-50c9-4018-be1b-f5f35f8a1eac service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-unplugged-8bd632f6-8b87-4591-99d1-d40b8571210f for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:03:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Instance destroyed successfully.
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lazy-loading 'resources' on Instance uuid 905d9e3a-da73-49a4-8548-81512b37fb86 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1493995148',display_name='tempest-TestMinimumBasicScenario-server-1493995148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1493995148',id=42,image_ref='9552c66b-73ee-458c-94e7-21dc56228115',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2I93PGahE8CofaI5Lsfzy5vgbIgz8PtWk9gshxoT3nqZWg1N8+gNUrCSUGqmJAJTv6jDZbS/9eL1zXvnmuoelBvZaBaWyoJawuunLD68CBk0ji6KqtnpZYpZOEgzD78A==',key_name='tempest-TestMinimumBasicScenario-1745147391',keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7bd80ef3ccb4c4e978990e15a2b0dd3',ramdisk_id='',reservation_id='r-tdb6kjfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9552c66b-73ee-458c-94e7-21dc56228115',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1149206322',owner_user_name='tempest-TestMinimumBasicScenario-1149206322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:00:57Z,user_data=None,user_id='b2b088eb7c0b47b2bc676cbc3f8a1b4c',uuid=905d9e3a-da73-49a4-8548-81512b37fb86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converting VIF {"id": "8bd632f6-8b87-4591-99d1-d40b8571210f", "address": "fa:16:3e:cc:50:3a", "network": {"id": "39f4e8c2-7f3d-4ac1-8411-464a4a324315", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1366246327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7bd80ef3ccb4c4e978990e15a2b0dd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd632f6-8b", "ovs_interfaceid": "8bd632f6-8b87-4591-99d1-d40b8571210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=8bd632f6-8b87-4591-99d1-d40b8571210f,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd632f6-8b') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG os_vif [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=8bd632f6-8b87-4591-99d1-d40b8571210f,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd632f6-8b') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bd632f6-8b, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53191f0a-7963-4833-b9ed-66e1e8e538a9) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:03:47 user nova-compute[75215]: INFO os_vif [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=8bd632f6-8b87-4591-99d1-d40b8571210f,network=Network(39f4e8c2-7f3d-4ac1-8411-464a4a324315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd632f6-8b')
Nov 11 02:03:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Deleting instance files /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86_del
Nov 11 02:03:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Deletion of /opt/stack/data/nova/instances/905d9e3a-da73-49a4-8548-81512b37fb86_del complete
Nov 11 02:03:47 user nova-compute[75215]: INFO nova.compute.manager [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 11 02:03:47 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:03:47 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Took 0.45 seconds to deallocate network for instance.
Nov 11 02:03:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:03:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:47 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Deleted allocations for instance 905d9e3a-da73-49a4-8548-81512b37fb86
Nov 11 02:03:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-ad444098-10d9-4891-93d2-0eb350c982d8 tempest-TestMinimumBasicScenario-1149206322 tempest-TestMinimumBasicScenario-1149206322-project-member] Lock "905d9e3a-da73-49a4-8548-81512b37fb86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.744s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-33447420-0b7f-4638-a6d9-1777b72f4d25 req-9eb1008c-d645-4f29-946a-6ea0af336c0c service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-deleted-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-d323b309-4a95-4d6f-971b-5abd312f4da4 req-d9e7c40f-7b68-4d0a-b04d-102a6eac9b0e service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d323b309-4a95-4d6f-971b-5abd312f4da4 req-d9e7c40f-7b68-4d0a-b04d-102a6eac9b0e service nova] Acquiring lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:03:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d323b309-4a95-4d6f-971b-5abd312f4da4 req-d9e7c40f-7b68-4d0a-b04d-102a6eac9b0e service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:03:48 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-d323b309-4a95-4d6f-971b-5abd312f4da4 req-d9e7c40f-7b68-4d0a-b04d-102a6eac9b0e service nova] Lock "905d9e3a-da73-49a4-8548-81512b37fb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:03:48 user nova-compute[75215]: DEBUG nova.compute.manager [req-d323b309-4a95-4d6f-971b-5abd312f4da4 req-d9e7c40f-7b68-4d0a-b04d-102a6eac9b0e service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] No waiting events found dispatching network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:03:48 user nova-compute[75215]: WARNING nova.compute.manager [req-d323b309-4a95-4d6f-971b-5abd312f4da4 req-d9e7c40f-7b68-4d0a-b04d-102a6eac9b0e service nova] [instance: 905d9e3a-da73-49a4-8548-81512b37fb86] Received unexpected event network-vif-plugged-8bd632f6-8b87-4591-99d1-d40b8571210f for instance with vm_state deleted and task_state None.
Nov 11 02:03:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-05dca6b6-2115-4fac-a261-39a8d221e4a2 req-bede5a02-2184-4daf-97d8-bb95064f1c46 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received event network-changed-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG nova.compute.manager [req-05dca6b6-2115-4fac-a261-39a8d221e4a2 req-bede5a02-2184-4daf-97d8-bb95064f1c46 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Refreshing instance network info cache due to event network-changed-257f8f7a-a8b9-41fc-9410-1f6857a86f73. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05dca6b6-2115-4fac-a261-39a8d221e4a2 req-bede5a02-2184-4daf-97d8-bb95064f1c46 service nova] Acquiring lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05dca6b6-2115-4fac-a261-39a8d221e4a2 req-bede5a02-2184-4daf-97d8-bb95064f1c46 service nova] Acquired lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG nova.network.neutron [req-05dca6b6-2115-4fac-a261-39a8d221e4a2 req-bede5a02-2184-4daf-97d8-bb95064f1c46 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Refreshing network info cache for port 257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG nova.network.neutron [req-05dca6b6-2115-4fac-a261-39a8d221e4a2 req-bede5a02-2184-4daf-97d8-bb95064f1c46 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updated VIF entry in instance network info cache for port 257f8f7a-a8b9-41fc-9410-1f6857a86f73. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG nova.network.neutron [req-05dca6b6-2115-4fac-a261-39a8d221e4a2 req-bede5a02-2184-4daf-97d8-bb95064f1c46 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updating instance_info_cache with network_info: [{"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:03:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-05dca6b6-2115-4fac-a261-39a8d221e4a2 req-bede5a02-2184-4daf-97d8-bb95064f1c46 service nova] Releasing lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:03:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:03:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "0980ed55-1b00-458d-abe1-19715c5a23dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:04:09 user nova-compute[75215]: INFO nova.compute.claims [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Claim successful on node user
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 02:04:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.network.neutron [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 02:04:09 user nova-compute[75215]: INFO nova.virt.block_device [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Booting with volume snapshot 2d2590e3-8d5b-4ca7-b1e0-e94d3b38f5d9 at /dev/vda
Nov 11 02:04:09 user nova-compute[75215]: DEBUG nova.policy [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '195d763c024c4db99be056d17d243171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5a366788b744f9b121b9e946ff230f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 02:04:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:10 user nova-compute[75215]: DEBUG nova.network.neutron [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Successfully created port: c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Successfully updated port: c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquired lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-4ebb5b9f-8e18-4b4e-89eb-bc2a299b4380 req-b409e778-7d6c-4a71-861b-4cd6de9f6f1f service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received event network-changed-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG nova.compute.manager [req-4ebb5b9f-8e18-4b4e-89eb-bc2a299b4380 req-b409e778-7d6c-4a71-861b-4cd6de9f6f1f service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Refreshing instance network info cache due to event network-changed-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4ebb5b9f-8e18-4b4e-89eb-bc2a299b4380 req-b409e778-7d6c-4a71-861b-4cd6de9f6f1f service nova] Acquiring lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG nova.network.neutron [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Updating instance_info_cache with network_info: [{"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Releasing lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Instance network_info: |[{"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4ebb5b9f-8e18-4b4e-89eb-bc2a299b4380 req-b409e778-7d6c-4a71-861b-4cd6de9f6f1f service nova] Acquired lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:04:11 user nova-compute[75215]: DEBUG nova.network.neutron [req-4ebb5b9f-8e18-4b4e-89eb-bc2a299b4380 req-b409e778-7d6c-4a71-861b-4cd6de9f6f1f service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Refreshing network info cache for port c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-4ebb5b9f-8e18-4b4e-89eb-bc2a299b4380 req-b409e778-7d6c-4a71-861b-4cd6de9f6f1f service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Updated VIF entry in instance network info cache for port c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-4ebb5b9f-8e18-4b4e-89eb-bc2a299b4380 req-b409e778-7d6c-4a71-861b-4cd6de9f6f1f service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Updating instance_info_cache with network_info: [{"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4ebb5b9f-8e18-4b4e-89eb-bc2a299b4380 req-b409e778-7d6c-4a71-861b-4cd6de9f6f1f service nova] Releasing lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUexVwPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:04:12 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:04:12 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:04:12 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b615b2d7-65f6-4698-84b4-b896f5a83e04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:04:12 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bf757f-a3a4-4eed-95c5-db7658b565c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a] added
Nov 11 02:04:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[87950d17-1984-411b-adc6-14cd32e762f2]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f480980-f23a-4dd5-b7b4-9c78530018f0]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUexVwPk {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUexVwPk" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b6b707-7ed4-41f0-b740-a03bf15317d9]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUexVwPk'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61bbbe0-6a84-4d56-8dfe-a4e7c673a15f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9651235-bc5b-4f19-b107-bc502e8de172]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:04:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:04:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bf4916-5383-4cab-984e-231da475ebfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a, portal: 172.16.0.220,3260]
Nov 11 02:04:12 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a, portal: 172.16.0.220,3260] successful.
Nov 11 02:04:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc991c-9b07-4efd-a34a-38ab2e950a4b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[52741b30-ca6c-4e94-ab00-b604f23987af]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:04:12 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:04:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:04:12 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:04:12 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f2a5c0-ef48-4be6-b381-a67d524d547d]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:12 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:04:13 user nova-compute[75215]: INFO nova.compute.claims [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Claim successful on node user
Nov 11 02:04:13 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUexVwPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23634336231316432', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634336231316432', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'flavor' on Instance uuid 6696ee6b-11f3-45b1-b023-558ab78db2fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 02:04:13 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:04:13 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 02:04:13 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:04:13 user nova-compute[75215]:   <serial>133a5de2-af47-4cfc-a738-9409a015d89a</serial>
Nov 11 02:04:13 user nova-compute[75215]: </disk>
Nov 11 02:04:13 user nova-compute[75215]:  {{(pid=75215) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 02:04:13 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.policy [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d0f3651de0743eb8cb0b03f2ad9d83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d240f44174c0b9a05c9ab2857a57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 02:04:13 user nova-compute[75215]: INFO nova.virt.block_device [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Booting with volume 94520099-7b8e-42c7-849f-b42dd84785f1 at /dev/vda
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] No VIF found with MAC fa:16:3e:6b:ef:6d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG os_brick.utils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0ce584-ff68-4d89-84f5-5ecdb392215c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3d435d-671c-4e4e-9b00-17cbad650976]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d99a1a46-00a1-451c-992b-4bf0c8c36bba tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.545s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbc4ec6-5624-453e-ba34-1f08389aeb32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b622aa-266d-4ae4-ab75-c4a42a6a4031]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:13 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:04:14 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:04:14 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6be0cb-c368-443d-b267-df5c7d1d1e98]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG os_brick.utils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating existing volume attachment record: 529b5c00-8e17-4940-ae63-96e344a9f288 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Successfully created port: c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 02:04:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Successfully updated port: c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquired lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a7e9022-f7db-4d45-9120-800c30c96fea req-5710cf3e-868c-427e-ac81-3463fe574759 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.compute.manager [req-7a7e9022-f7db-4d45-9120-800c30c96fea req-5710cf3e-868c-427e-ac81-3463fe574759 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing instance network info cache due to event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a7e9022-f7db-4d45-9120-800c30c96fea req-5710cf3e-868c-427e-ac81-3463fe574759 service nova] Acquiring lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Releasing lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance network_info: |[{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a7e9022-f7db-4d45-9120-800c30c96fea req-5710cf3e-868c-427e-ac81-3463fe574759 service nova] Acquired lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-7a7e9022-f7db-4d45-9120-800c30c96fea req-5710cf3e-868c-427e-ac81-3463fe574759 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-7a7e9022-f7db-4d45-9120-800c30c96fea req-5710cf3e-868c-427e-ac81-3463fe574759 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updated VIF entry in instance network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-7a7e9022-f7db-4d45-9120-800c30c96fea req-5710cf3e-868c-427e-ac81-3463fe574759 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:04:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7a7e9022-f7db-4d45-9120-800c30c96fea req-5710cf3e-868c-427e-ac81-3463fe574759 service nova] Releasing lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:04:17 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG os_brick.utils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2cb7e7-29c1-44fb-9c16-c0390131c873]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2da600-42c1-40e9-b575-8fbdb3dde7a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb72f48-033f-4ffe-ab85-3fcd47e61515]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed260d91-ff13-4e05-8d37-5be605960a82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:04:20 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:04:20 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[47df07e0-879c-4536-9f4f-52ae96d44ad1]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG os_brick.utils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:04:20 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Updating existing volume attachment record: fe982d90-295a-4a61-8b7c-8368ed284cde {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:04:22 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:04:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:27 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:04:32 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:04:33 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:04:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8565MB free_disk=25.079883575439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6696ee6b-11f3-45b1-b023-558ab78db2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2d5bf74a-2b67-4210-b3df-709f11ca6799 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0980ed55-1b00-458d-abe1-19715c5a23dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5728a539-e1b8-4ee4-b04e-7cbb956cc40d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:04:33 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:04:34 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:04:34 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:04:34 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:04:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:04:37 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:04:42 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Skipping network cache update for instance because it is Building. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Skipping network cache update for instance because it is Building. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:04:44 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 7957c525-01f2-4fbb-924d-78294385345a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:04:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updating instance_info_cache with network_info: [{"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:04:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:04:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:04:46 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Creating image(s)
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Ensure instance console log exists: /opt/stack/data/nova/instances/0980ed55-1b00-458d-abe1-19715c5a23dd/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Start _get_guest_xml network_info=[{"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-11T02:03:56Z,direct_url=<?>,disk_format='qcow2',id=a3e28bd1-7890-4b9e-92c0-b7a6bafb6fd4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-102329446',owner='ca5a366788b744f9b121b9e946ff230f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-11T02:03:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'fe982d90-295a-4a61-8b7c-8368ed284cde', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbiyhpDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0980ed55-1b00-458d-abe1-19715c5a23dd', 'attached_at': '', 'detached_at': '', 'volume_id': '0f8cf674-6161-41b7-986c-2f3f32e47963', 'serial': '0f8cf674-6161-41b7-986c-2f3f32e47963'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:04:46 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:04:46 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-11T02:03:56Z,direct_url=<?>,disk_format='qcow2',id=a3e28bd1-7890-4b9e-92c0-b7a6bafb6fd4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-102329446',owner='ca5a366788b744f9b121b9e946ff230f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-11T02:03:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbiyhpDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:04:46 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:04:46 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:04:46 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c205903-1eb4-4750-85ed-3cf6f1200d59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:04:46 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9933cd-0a3f-4e2f-ba62-93284d3e37a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963] added
Nov 11 02:04:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a693e7-8721-43dd-bf41-09bc4d890bfa]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[87413cfe-fb14-4eb9-9863-f9acde09ee7e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbiyhpDA {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbiyhpDA" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fde788-e7d5-45a8-a2c0-2aa735462f2d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HbiyhpDA'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94634096-b75a-4dcb-abd3-c625be0a4107]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2581f2a-fc3f-4b56-883f-7e819593e436]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:04:46 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:04:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:04:46 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:04:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[514ebe48-a42c-432b-9446-871995726241]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963, portal: 172.16.0.220,3260]
Nov 11 02:04:46 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963, portal: 172.16.0.220,3260] successful.
Nov 11 02:04:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a74a3-799b-4f59-a124-fede47fe7a7f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[704f2dad-51fd-4a07-81b3-6272ba9e5427]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:04:46 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:04:46 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)
Nov 11 02:04:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:04:46 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:04:46 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)
Nov 11 02:04:46 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[40881400-1b1d-4d15-98c2-9e2367837f35]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:04:46 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbiyhpDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26166323666613734', 'path': '/dev/sdd'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166323666613734', 'path': '/dev/sdd'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-834747072',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-834747072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-834747072',id=48,image_ref='a3e28bd1-7890-4b9e-92c0-b7a6bafb6fd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbsiGf9Gqz9bhVPUnhUXes8WLfBGJ+8w4aLYrZjoxupnM29e/PXYXNQ3pvjr7PfhYqoIIAnJKFeNBbXjFhHhP5xza05aHaD/T+ETX5WrptNVE35ovrQLXrFYI2f2/vaaQ==',key_name='tempest-keypair-1286062898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-tj53fspf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1487726842',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195d763c024c4db99be056d17d243171',uuid=0980ed55-1b00-458d-abe1-19715c5a23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:d2,bridge_name='br-int',has_traffic_filtering=True,id=c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6b0fd4c-ae') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:04:47 user nova-compute[75215]: DEBUG nova.objects.instance [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'pci_devices' on Instance uuid 0980ed55-1b00-458d-abe1-19715c5a23dd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:04:48 user nova-compute[75215]:   <uuid>0980ed55-1b00-458d-abe1-19715c5a23dd</uuid>
Nov 11 02:04:48 user nova-compute[75215]:   <name>instance-00000030</name>
Nov 11 02:04:48 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:04:48 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:04:48 user nova-compute[75215]:   <metadata>
Nov 11 02:04:48 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:04:48 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:04:48 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-834747072</nova:name>
Nov 11 02:04:48 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:04:46</nova:creationTime>
Nov 11 02:04:48 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:04:48 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:04:48 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:04:48 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:04:48 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:04:48 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:04:48 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:04:48 user nova-compute[75215]:       <nova:owner>
Nov 11 02:04:48 user nova-compute[75215]:         <nova:user uuid="195d763c024c4db99be056d17d243171">tempest-TestVolumeBootPattern-1487726842-project-member</nova:user>
Nov 11 02:04:48 user nova-compute[75215]:         <nova:project uuid="ca5a366788b744f9b121b9e946ff230f">tempest-TestVolumeBootPattern-1487726842</nova:project>
Nov 11 02:04:48 user nova-compute[75215]:       </nova:owner>
Nov 11 02:04:48 user nova-compute[75215]:       <nova:root type="image" uuid="a3e28bd1-7890-4b9e-92c0-b7a6bafb6fd4"/>
Nov 11 02:04:48 user nova-compute[75215]:       <nova:ports>
Nov 11 02:04:48 user nova-compute[75215]:         <nova:port uuid="c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7">
Nov 11 02:04:48 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 02:04:48 user nova-compute[75215]:         </nova:port>
Nov 11 02:04:48 user nova-compute[75215]:       </nova:ports>
Nov 11 02:04:48 user nova-compute[75215]:     </nova:instance>
Nov 11 02:04:48 user nova-compute[75215]:   </metadata>
Nov 11 02:04:48 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:04:48 user nova-compute[75215]:     <system>
Nov 11 02:04:48 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:04:48 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:04:48 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:04:48 user nova-compute[75215]:       <entry name="serial">0980ed55-1b00-458d-abe1-19715c5a23dd</entry>
Nov 11 02:04:48 user nova-compute[75215]:       <entry name="uuid">0980ed55-1b00-458d-abe1-19715c5a23dd</entry>
Nov 11 02:04:48 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:04:48 user nova-compute[75215]:     </system>
Nov 11 02:04:48 user nova-compute[75215]:   </sysinfo>
Nov 11 02:04:48 user nova-compute[75215]:   <os>
Nov 11 02:04:48 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:04:48 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:04:48 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:04:48 user nova-compute[75215]:   </os>
Nov 11 02:04:48 user nova-compute[75215]:   <features>
Nov 11 02:04:48 user nova-compute[75215]:     <acpi/>
Nov 11 02:04:48 user nova-compute[75215]:     <apic/>
Nov 11 02:04:48 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:04:48 user nova-compute[75215]:   </features>
Nov 11 02:04:48 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:04:48 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:04:48 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:04:48 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:04:48 user nova-compute[75215]:   </clock>
Nov 11 02:04:48 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:04:48 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:04:48 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:04:48 user nova-compute[75215]:   </cpu>
Nov 11 02:04:48 user nova-compute[75215]:   <devices>
Nov 11 02:04:48 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 02:04:48 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:04:48 user nova-compute[75215]:       <source dev="/dev/sdd"/>
Nov 11 02:04:48 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:04:48 user nova-compute[75215]:       <serial>0f8cf674-6161-41b7-986c-2f3f32e47963</serial>
Nov 11 02:04:48 user nova-compute[75215]:     </disk>
Nov 11 02:04:48 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:04:48 user nova-compute[75215]:       <mac address="fa:16:3e:e7:60:d2"/>
Nov 11 02:04:48 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:04:48 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:04:48 user nova-compute[75215]:       <target dev="tapc6b0fd4c-ae"/>
Nov 11 02:04:48 user nova-compute[75215]:     </interface>
Nov 11 02:04:48 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:04:48 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/0980ed55-1b00-458d-abe1-19715c5a23dd/console.log" append="off"/>
Nov 11 02:04:48 user nova-compute[75215]:     </serial>
Nov 11 02:04:48 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:04:48 user nova-compute[75215]:     <video>
Nov 11 02:04:48 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:04:48 user nova-compute[75215]:     </video>
Nov 11 02:04:48 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:04:48 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:04:48 user nova-compute[75215]:     </rng>
Nov 11 02:04:48 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:04:48 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:04:48 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:04:48 user nova-compute[75215]:     </memballoon>
Nov 11 02:04:48 user nova-compute[75215]:   </devices>
Nov 11 02:04:48 user nova-compute[75215]: </domain>
Nov 11 02:04:48 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-834747072',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-834747072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-834747072',id=48,image_ref='a3e28bd1-7890-4b9e-92c0-b7a6bafb6fd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbsiGf9Gqz9bhVPUnhUXes8WLfBGJ+8w4aLYrZjoxupnM29e/PXYXNQ3pvjr7PfhYqoIIAnJKFeNBbXjFhHhP5xza05aHaD/T+ETX5WrptNVE35ovrQLXrFYI2f2/vaaQ==',key_name='tempest-keypair-1286062898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-tj53fspf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1487726842',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195d763c024c4db99be056d17d243171',uuid=0980ed55-1b00-458d-abe1-19715c5a23dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:d2,bridge_name='br-int',has_traffic_filtering=True,id=c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6b0fd4c-ae') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG os_vif [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:d2,bridge_name='br-int',has_traffic_filtering=True,id=c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6b0fd4c-ae') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a3058b1-bc85-50cb-b6c4-b17a4c513c05', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6b0fd4c-ae, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6b0fd4c-ae, col_values=(('qos', UUID('9724754f-8e49-4605-8694-fefe6ee4cd1e')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6b0fd4c-ae, col_values=(('external_ids', {'iface-id': 'c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:60:d2', 'vm-uuid': '0980ed55-1b00-458d-abe1-19715c5a23dd'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:48 user nova-compute[75215]: INFO os_vif [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:d2,bridge_name='br-int',has_traffic_filtering=True,id=c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6b0fd4c-ae')
Nov 11 02:04:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:04:48 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No VIF found with MAC fa:16:3e:e7:60:d2, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-7077dca0-6399-4d8b-a2e4-5d64835fd5fd req-31668185-3a4e-4fa2-9839-64013c0ba42d service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received event network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7077dca0-6399-4d8b-a2e4-5d64835fd5fd req-31668185-3a4e-4fa2-9839-64013c0ba42d service nova] Acquiring lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7077dca0-6399-4d8b-a2e4-5d64835fd5fd req-31668185-3a4e-4fa2-9839-64013c0ba42d service nova] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7077dca0-6399-4d8b-a2e4-5d64835fd5fd req-31668185-3a4e-4fa2-9839-64013c0ba42d service nova] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG nova.compute.manager [req-7077dca0-6399-4d8b-a2e4-5d64835fd5fd req-31668185-3a4e-4fa2-9839-64013c0ba42d service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] No waiting events found dispatching network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:04:49 user nova-compute[75215]: WARNING nova.compute.manager [req-7077dca0-6399-4d8b-a2e4-5d64835fd5fd req-31668185-3a4e-4fa2-9839-64013c0ba42d service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received unexpected event network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 for instance with vm_state building and task_state spawning.
Nov 11 02:04:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:04:51 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Instance spawned successfully.
Nov 11 02:04:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:04:51 user nova-compute[75215]: INFO nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 11 02:04:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-80501014-6e06-4fa9-9a47-98bc48bf84df req-c76363ec-580e-4aa8-875b-457796842603 service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received event network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80501014-6e06-4fa9-9a47-98bc48bf84df req-c76363ec-580e-4aa8-875b-457796842603 service nova] Acquiring lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80501014-6e06-4fa9-9a47-98bc48bf84df req-c76363ec-580e-4aa8-875b-457796842603 service nova] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-80501014-6e06-4fa9-9a47-98bc48bf84df req-c76363ec-580e-4aa8-875b-457796842603 service nova] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:51 user nova-compute[75215]: DEBUG nova.compute.manager [req-80501014-6e06-4fa9-9a47-98bc48bf84df req-c76363ec-580e-4aa8-875b-457796842603 service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] No waiting events found dispatching network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:04:51 user nova-compute[75215]: WARNING nova.compute.manager [req-80501014-6e06-4fa9-9a47-98bc48bf84df req-c76363ec-580e-4aa8-875b-457796842603 service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received unexpected event network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 for instance with vm_state building and task_state spawning.
Nov 11 02:04:51 user nova-compute[75215]: INFO nova.compute.manager [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Took 42.31 seconds to build instance.
Nov 11 02:04:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-073d784e-ae18-4778-a581-5c816139983b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.435s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:04:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:04:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:04:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:05:03 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Creating image(s)
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Ensure instance console log exists: /opt/stack/data/nova/instances/5728a539-e1b8-4ee4-b04e-7cbb956cc40d/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Start _get_guest_xml network_info=[{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '529b5c00-8e17-4940-ae63-96e344a9f288', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFdAjbOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5728a539-e1b8-4ee4-b04e-7cbb956cc40d', 'attached_at': '', 'detached_at': '', 'volume_id': '94520099-7b8e-42c7-849f-b42dd84785f1', 'serial': '94520099-7b8e-42c7-849f-b42dd84785f1'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:05:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:05:03 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:05:03 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFdAjbOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:05:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:05:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:05:04 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[985e7bce-8427-4fe1-a3db-9f425a539bd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:05:04 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea64ead-8ebe-4629-89a9-69066c34704b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1] added
Nov 11 02:05:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[04832974-4081-4219-8eec-3777ab812ab8]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c8fd3-233f-42fb-a6c2-691a66fbed2b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFdAjbOP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFdAjbOP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[64164029-d631-44b6-b9ad-ed74ccf188af]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFdAjbOP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[508b8747-564c-4dc1-9728-247db176d610]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72a8491-cca2-44ba-af69-c6ceb7fd422d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)
Nov 11 02:05:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)
Nov 11 02:05:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[31445df0-5806-45b1-9176-a8bda444d212]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260]
Nov 11 02:05:04 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260] successful.
Nov 11 02:05:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[447b82ae-b6b3-4303-9ff8-9273213b224b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85586a-95fa-4d50-a8f3-4d515f6c4f7a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:05:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)
Nov 11 02:05:04 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:05:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc180691-d69a-4d35-be68-be31cbec9b92]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:05:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFdAjbOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26334346637623263', 'path': '/dev/sde'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334346637623263', 'path': '/dev/sde'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671404116',display_name='tempest-TestShelveInstance-server-1671404116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671404116',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFfvDPEwJ58zp0oTZPTcZf7TB1Yy6UkEm88Wv/5C2f/phGmTfOfLikqUU065E0kV13kN7pjaZfgxeKJDmn4Kw2VaABAUzwEDEFEEmiMK9UlXKb7pO89B1nOl8lnyEOM5A==',key_name='tempest-TestShelveInstance-580171368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7d240f44174c0b9a05c9ab2857a57a',ramdisk_id='',reservation_id='r-esh6lg1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-160686239',owner_user_name='tempest-TestShelveInstance-160686239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:04:14Z,user_data=None,user_id='5d0f3651de0743eb8cb0b03f2ad9d83b',uuid=5728a539-e1b8-4ee4-b04e-7cbb956cc40d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converting VIF {"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.objects.instance [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lazy-loading 'pci_devices' on Instance uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:05:05 user nova-compute[75215]:   <uuid>5728a539-e1b8-4ee4-b04e-7cbb956cc40d</uuid>
Nov 11 02:05:05 user nova-compute[75215]:   <name>instance-00000031</name>
Nov 11 02:05:05 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:05:05 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:05:05 user nova-compute[75215]:   <metadata>
Nov 11 02:05:05 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:05:05 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:05:05 user nova-compute[75215]:       <nova:name>tempest-TestShelveInstance-server-1671404116</nova:name>
Nov 11 02:05:05 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:05:03</nova:creationTime>
Nov 11 02:05:05 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:05:05 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:05:05 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:05:05 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:05:05 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:05:05 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:05:05 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:05:05 user nova-compute[75215]:       <nova:owner>
Nov 11 02:05:05 user nova-compute[75215]:         <nova:user uuid="5d0f3651de0743eb8cb0b03f2ad9d83b">tempest-TestShelveInstance-160686239-project-member</nova:user>
Nov 11 02:05:05 user nova-compute[75215]:         <nova:project uuid="5a7d240f44174c0b9a05c9ab2857a57a">tempest-TestShelveInstance-160686239</nova:project>
Nov 11 02:05:05 user nova-compute[75215]:       </nova:owner>
Nov 11 02:05:05 user nova-compute[75215]:       <nova:ports>
Nov 11 02:05:05 user nova-compute[75215]:         <nova:port uuid="c34bf040-7798-4da0-a95e-3c8569f9b815">
Nov 11 02:05:05 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 02:05:05 user nova-compute[75215]:         </nova:port>
Nov 11 02:05:05 user nova-compute[75215]:       </nova:ports>
Nov 11 02:05:05 user nova-compute[75215]:     </nova:instance>
Nov 11 02:05:05 user nova-compute[75215]:   </metadata>
Nov 11 02:05:05 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:05:05 user nova-compute[75215]:     <system>
Nov 11 02:05:05 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:05:05 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:05:05 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:05:05 user nova-compute[75215]:       <entry name="serial">5728a539-e1b8-4ee4-b04e-7cbb956cc40d</entry>
Nov 11 02:05:05 user nova-compute[75215]:       <entry name="uuid">5728a539-e1b8-4ee4-b04e-7cbb956cc40d</entry>
Nov 11 02:05:05 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:05:05 user nova-compute[75215]:     </system>
Nov 11 02:05:05 user nova-compute[75215]:   </sysinfo>
Nov 11 02:05:05 user nova-compute[75215]:   <os>
Nov 11 02:05:05 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:05:05 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:05:05 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:05:05 user nova-compute[75215]:   </os>
Nov 11 02:05:05 user nova-compute[75215]:   <features>
Nov 11 02:05:05 user nova-compute[75215]:     <acpi/>
Nov 11 02:05:05 user nova-compute[75215]:     <apic/>
Nov 11 02:05:05 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:05:05 user nova-compute[75215]:   </features>
Nov 11 02:05:05 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:05:05 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:05:05 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:05:05 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:05:05 user nova-compute[75215]:   </clock>
Nov 11 02:05:05 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:05:05 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:05:05 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:05:05 user nova-compute[75215]:   </cpu>
Nov 11 02:05:05 user nova-compute[75215]:   <devices>
Nov 11 02:05:05 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 02:05:05 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:05:05 user nova-compute[75215]:       <source dev="/dev/sde"/>
Nov 11 02:05:05 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:05:05 user nova-compute[75215]:       <serial>94520099-7b8e-42c7-849f-b42dd84785f1</serial>
Nov 11 02:05:05 user nova-compute[75215]:     </disk>
Nov 11 02:05:05 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:05:05 user nova-compute[75215]:       <mac address="fa:16:3e:9f:24:4a"/>
Nov 11 02:05:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:05:05 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:05:05 user nova-compute[75215]:       <target dev="tapc34bf040-77"/>
Nov 11 02:05:05 user nova-compute[75215]:     </interface>
Nov 11 02:05:05 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:05:05 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/5728a539-e1b8-4ee4-b04e-7cbb956cc40d/console.log" append="off"/>
Nov 11 02:05:05 user nova-compute[75215]:     </serial>
Nov 11 02:05:05 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:05:05 user nova-compute[75215]:     <video>
Nov 11 02:05:05 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:05:05 user nova-compute[75215]:     </video>
Nov 11 02:05:05 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:05:05 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:05:05 user nova-compute[75215]:     </rng>
Nov 11 02:05:05 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:05:05 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:05:05 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:05:05 user nova-compute[75215]:     </memballoon>
Nov 11 02:05:05 user nova-compute[75215]:   </devices>
Nov 11 02:05:05 user nova-compute[75215]: </domain>
Nov 11 02:05:05 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671404116',display_name='tempest-TestShelveInstance-server-1671404116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671404116',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFfvDPEwJ58zp0oTZPTcZf7TB1Yy6UkEm88Wv/5C2f/phGmTfOfLikqUU065E0kV13kN7pjaZfgxeKJDmn4Kw2VaABAUzwEDEFEEmiMK9UlXKb7pO89B1nOl8lnyEOM5A==',key_name='tempest-TestShelveInstance-580171368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7d240f44174c0b9a05c9ab2857a57a',ramdisk_id='',reservation_id='r-esh6lg1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-160686239',owner_user_name='tempest-TestShelveInstance-160686239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:04:14Z,user_data=None,user_id='5d0f3651de0743eb8cb0b03f2ad9d83b',uuid=5728a539-e1b8-4ee4-b04e-7cbb956cc40d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converting VIF {"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG os_vif [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae43ffea-f823-502e-8da5-f9c0324a0871', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc34bf040-77, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc34bf040-77, col_values=(('qos', UUID('76412315-7972-438d-b264-251716e3092d')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc34bf040-77, col_values=(('external_ids', {'iface-id': 'c34bf040-7798-4da0-a95e-3c8569f9b815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:24:4a', 'vm-uuid': '5728a539-e1b8-4ee4-b04e-7cbb956cc40d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:05 user nova-compute[75215]: INFO os_vif [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77')
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:05:05 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] No VIF found with MAC fa:16:3e:9f:24:4a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:05:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-87cb3201-17a6-4225-87fc-775bbd4fa1c9 req-88abf170-e043-48e0-acd4-2bf2a6982b68 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-87cb3201-17a6-4225-87fc-775bbd4fa1c9 req-88abf170-e043-48e0-acd4-2bf2a6982b68 service nova] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-87cb3201-17a6-4225-87fc-775bbd4fa1c9 req-88abf170-e043-48e0-acd4-2bf2a6982b68 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-87cb3201-17a6-4225-87fc-775bbd4fa1c9 req-88abf170-e043-48e0-acd4-2bf2a6982b68 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.compute.manager [req-87cb3201-17a6-4225-87fc-775bbd4fa1c9 req-88abf170-e043-48e0-acd4-2bf2a6982b68 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] No waiting events found dispatching network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.compute.manager [req-87cb3201-17a6-4225-87fc-775bbd4fa1c9 req-88abf170-e043-48e0-acd4-2bf2a6982b68 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received unexpected event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 for instance with vm_state building and task_state spawning.
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Verify base images {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Image id a3e28bd1-7890-4b9e-92c0-b7a6bafb6fd4 yields fingerprint 5dc6af5a8bc8d1b925411ad536c95e8254797312 {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Image id ff07f7e9-c859-41fd-adb3-c436d43c7526 yields fingerprint 47f6495ab3b8176c5a78e8f4d49574d92fdd0137 {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] image ff07f7e9-c859-41fd-adb3-c436d43c7526 at (/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137): checking
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] image ff07f7e9-c859-41fd-adb3-c436d43c7526 at (/opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137): image is in use {{(pid=75215) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] 0980ed55-1b00-458d-abe1-19715c5a23dd is a valid instance name {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] 6696ee6b-11f3-45b1-b023-558ab78db2fd is a valid instance name {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] 6696ee6b-11f3-45b1-b023-558ab78db2fd has a disk file {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6696ee6b-11f3-45b1-b023-558ab78db2fd is backed by 47f6495ab3b8176c5a78e8f4d49574d92fdd0137 {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] 5728a539-e1b8-4ee4-b04e-7cbb956cc40d is a valid instance name {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] 2d5bf74a-2b67-4210-b3df-709f11ca6799 is a valid instance name {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] 7957c525-01f2-4fbb-924d-78294385345a is a valid instance name {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] 7957c525-01f2-4fbb-924d-78294385345a has a disk file {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a is backed by 47f6495ab3b8176c5a78e8f4d49574d92fdd0137 {{(pid=75215) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Unknown base file: /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Unknown base file: /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Unknown base file: /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Unknown base file: /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Unknown base file: /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Unknown base file: /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Unknown base file: /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf
Nov 11 02:05:07 user nova-compute[75215]: WARNING nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Unknown base file: /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Active base files: /opt/stack/data/nova/instances/_base/47f6495ab3b8176c5a78e8f4d49574d92fdd0137
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Removable base files: /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852 /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6 /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093 /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432 /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bb3466c6fb4ad7a10686dd6a372810e23f667852
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b62580a274afb19c54c8fb30575b2fe921e6b6d6
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aa60511f7e83891e863bae675edd19b466c13093
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/21fe5f9694d7ad27375f2dea7cbac7907a7a38cf
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4df477c70017a78c314ca5eea4019b1447c2c432
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e6cc1d68996fa4e115df27f975fdf68ec4d1637f
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/af6806dbad48584031918bd8a1f7b03e96b4b8bf
Nov 11 02:05:07 user nova-compute[75215]: INFO nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a96d091fe01647bd791465498db9070338bb1ab7
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Verification complete {{(pid=75215) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Verify swap images {{(pid=75215) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 11 02:05:07 user nova-compute[75215]: DEBUG nova.virt.libvirt.imagecache [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Verify ephemeral images {{(pid=75215) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:05:09 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance spawned successfully.
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-f2512498-8a6a-4e2d-bc71-be2f4d373d6b req-72948053-cc31-46f1-8d3a-13d979298f71 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f2512498-8a6a-4e2d-bc71-be2f4d373d6b req-72948053-cc31-46f1-8d3a-13d979298f71 service nova] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f2512498-8a6a-4e2d-bc71-be2f4d373d6b req-72948053-cc31-46f1-8d3a-13d979298f71 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f2512498-8a6a-4e2d-bc71-be2f4d373d6b req-72948053-cc31-46f1-8d3a-13d979298f71 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-f2512498-8a6a-4e2d-bc71-be2f4d373d6b req-72948053-cc31-46f1-8d3a-13d979298f71 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] No waiting events found dispatching network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:05:09 user nova-compute[75215]: WARNING nova.compute.manager [req-f2512498-8a6a-4e2d-bc71-be2f4d373d6b req-72948053-cc31-46f1-8d3a-13d979298f71 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received unexpected event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 for instance with vm_state building and task_state spawning.
Nov 11 02:05:09 user nova-compute[75215]: INFO nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 11 02:05:09 user nova-compute[75215]: DEBUG nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:05:09 user nova-compute[75215]: INFO nova.compute.manager [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Took 55.94 seconds to build instance.
Nov 11 02:05:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-6dfa8946-3b5f-42e6-9be4-8954bfa9d328 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.050s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:05:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:05:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:05:34 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:05:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:05:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:05:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8336MB free_disk=25.11575698852539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 6696ee6b-11f3-45b1-b023-558ab78db2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2d5bf74a-2b67-4210-b3df-709f11ca6799 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 0980ed55-1b00-458d-abe1-19715c5a23dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5728a539-e1b8-4ee4-b04e-7cbb956cc40d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:05:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:05:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:05:41 user nova-compute[75215]: INFO nova.compute.manager [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Detaching volume 133a5de2-af47-4cfc-a738-9409a015d89a
Nov 11 02:05:41 user nova-compute[75215]: INFO nova.virt.block_device [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Attempting to driver detach volume 133a5de2-af47-4cfc-a738-9409a015d89a from mountpoint /dev/vdb
Nov 11 02:05:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Attempting to detach device vdb from instance 6696ee6b-11f3-45b1-b023-558ab78db2fd from the persistent domain config. {{(pid=75215) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 02:05:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 02:05:41 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:05:41 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 02:05:41 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:05:41 user nova-compute[75215]:   <serial>133a5de2-af47-4cfc-a738-9409a015d89a</serial>
Nov 11 02:05:41 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 02:05:41 user nova-compute[75215]: </disk>
Nov 11 02:05:41 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 02:05:41 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Successfully detached device vdb from instance 6696ee6b-11f3-45b1-b023-558ab78db2fd from the persistent domain config.
Nov 11 02:05:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6696ee6b-11f3-45b1-b023-558ab78db2fd from the live domain config. {{(pid=75215) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 02:05:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.guest [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 02:05:41 user nova-compute[75215]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:05:41 user nova-compute[75215]:   <source dev="/dev/sdb"/>
Nov 11 02:05:41 user nova-compute[75215]:   <target dev="vdb" bus="virtio"/>
Nov 11 02:05:41 user nova-compute[75215]:   <serial>133a5de2-af47-4cfc-a738-9409a015d89a</serial>
Nov 11 02:05:41 user nova-compute[75215]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 02:05:41 user nova-compute[75215]: </disk>
Nov 11 02:05:41 user nova-compute[75215]:  {{(pid=75215) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 02:05:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:05:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6696ee6b-11f3-45b1-b023-558ab78db2fd {{(pid=75215) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 02:05:42 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:05:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Skipping network cache update for instance because it is being deleted. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updating instance_info_cache with network_info: [{"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-2d5bf74a-2b67-4210-b3df-709f11ca6799" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:05:44 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:05:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:05:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:05:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:05:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:05:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:05:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:05:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 02:05:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 02:05:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:05:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:05:56 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-f3ee683e-ca60-43d1-9a1a-4f0e5d79b1ad req-b781586d-8a73-4bc1-84ba-296f0ca23d9e service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received event network-changed-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-f3ee683e-ca60-43d1-9a1a-4f0e5d79b1ad req-b781586d-8a73-4bc1-84ba-296f0ca23d9e service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Refreshing instance network info cache due to event network-changed-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f3ee683e-ca60-43d1-9a1a-4f0e5d79b1ad req-b781586d-8a73-4bc1-84ba-296f0ca23d9e service nova] Acquiring lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f3ee683e-ca60-43d1-9a1a-4f0e5d79b1ad req-b781586d-8a73-4bc1-84ba-296f0ca23d9e service nova] Acquired lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG nova.network.neutron [req-f3ee683e-ca60-43d1-9a1a-4f0e5d79b1ad req-b781586d-8a73-4bc1-84ba-296f0ca23d9e service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Refreshing network info cache for port c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "0980ed55-1b00-458d-abe1-19715c5a23dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:00 user nova-compute[75215]: INFO nova.compute.manager [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Terminating instance
Nov 11 02:06:00 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-ee709e14-5226-42d2-aad8-00955dcd2776 req-1dc3f514-cac5-4c1c-84bf-63253dda172f service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received event network-vif-unplugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee709e14-5226-42d2-aad8-00955dcd2776 req-1dc3f514-cac5-4c1c-84bf-63253dda172f service nova] Acquiring lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee709e14-5226-42d2-aad8-00955dcd2776 req-1dc3f514-cac5-4c1c-84bf-63253dda172f service nova] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-ee709e14-5226-42d2-aad8-00955dcd2776 req-1dc3f514-cac5-4c1c-84bf-63253dda172f service nova] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-ee709e14-5226-42d2-aad8-00955dcd2776 req-1dc3f514-cac5-4c1c-84bf-63253dda172f service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] No waiting events found dispatching network-vif-unplugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.compute.manager [req-ee709e14-5226-42d2-aad8-00955dcd2776 req-1dc3f514-cac5-4c1c-84bf-63253dda172f service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received event network-vif-unplugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-f3ee683e-ca60-43d1-9a1a-4f0e5d79b1ad req-b781586d-8a73-4bc1-84ba-296f0ca23d9e service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Updated VIF entry in instance network info cache for port c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.network.neutron [req-f3ee683e-ca60-43d1-9a1a-4f0e5d79b1ad req-b781586d-8a73-4bc1-84ba-296f0ca23d9e service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Updating instance_info_cache with network_info: [{"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f3ee683e-ca60-43d1-9a1a-4f0e5d79b1ad req-b781586d-8a73-4bc1-84ba-296f0ca23d9e service nova] Releasing lock "refresh_cache-0980ed55-1b00-458d-abe1-19715c5a23dd" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Instance destroyed successfully.
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'resources' on Instance uuid 0980ed55-1b00-458d-abe1-19715c5a23dd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-834747072',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-834747072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-834747072',id=48,image_ref='a3e28bd1-7890-4b9e-92c0-b7a6bafb6fd4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbsiGf9Gqz9bhVPUnhUXes8WLfBGJ+8w4aLYrZjoxupnM29e/PXYXNQ3pvjr7PfhYqoIIAnJKFeNBbXjFhHhP5xza05aHaD/T+ETX5WrptNVE35ovrQLXrFYI2f2/vaaQ==',key_name='tempest-keypair-1286062898',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:04:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-tj53fspf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1487726842',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:04:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195d763c024c4db99be056d17d243171',uuid=0980ed55-1b00-458d-abe1-19715c5a23dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "address": "fa:16:3e:e7:60:d2", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6b0fd4c-ae", "ovs_interfaceid": "c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:d2,bridge_name='br-int',has_traffic_filtering=True,id=c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6b0fd4c-ae') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_vif [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:d2,bridge_name='br-int',has_traffic_filtering=True,id=c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6b0fd4c-ae') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6b0fd4c-ae, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9724754f-8e49-4605-8694-fefe6ee4cd1e) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:01 user nova-compute[75215]: INFO os_vif [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:d2,bridge_name='br-int',has_traffic_filtering=True,id=c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6b0fd4c-ae')
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbiyhpDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:06:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa6458a-0e0b-4ad5-b99a-1e8b4321f2fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:06:01 user nova-compute[75215]: No targets found.
Nov 11 02:06:01 user nova-compute[75215]: iSNS:
Nov 11 02:06:01 user nova-compute[75215]: No targets found.
Nov 11 02:06:01 user nova-compute[75215]: STATIC:
Nov 11 02:06:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e
Nov 11 02:06:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:01 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1
Nov 11 02:06:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:01 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a
Nov 11 02:06:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:01 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963
Nov 11 02:06:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:01 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:01 user nova-compute[75215]: FIRMWARE:
Nov 11 02:06:01 user nova-compute[75215]: No targets found.
Nov 11 02:06:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:06:01 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:06:01 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[94233341-d80d-4b2b-9cd6-9d6651ea2058]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce589ee-621e-488a-b0d2-16318a368a15]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:06:01 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:06:01 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)
Nov 11 02:06:01 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:06:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:06:01 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:06:01 user nova-compute[75215]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 (non-flash)
Nov 11 02:06:01 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:06:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404435f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963'): ({'sdd'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Removing single pathed devices sdd {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84dd455-a4a8-4b95-be09-b7dfe695afd6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeee7c9-3eef-47ce-9bab-bd259db6432e]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flushing IO for device /dev/sdd {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea737c2-1680-4a80-8ae8-77d4ca8a7d1b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79da520-5662-431b-9d04-d705df47f919]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] SCSI volumes sdd have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26166323666613734', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_91678888', '/dev/disk/by-id/scsi-1SCST_BIO91678888-af26fa7459df0936') {{(pid=86647) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 02:06:01 user nova-compute[75215]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26166323666613734
Nov 11 02:06:01 user nova-compute[75215]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_91678888
Nov 11 02:06:01 user nova-compute[75215]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO91678888-af26fa7459df0936
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142eed9-290a-4e28-a2c4-f72857cd3f24]: (4, None) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4d6abe-c30d-4a43-b06a-1f9e1a6bc05c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6696ee6b-11f3-45b1-b023-558ab78db2fd is timed out.
Nov 11 02:06:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Successfully detached device vdb from instance 6696ee6b-11f3-45b1-b023-558ab78db2fd from the live domain config.
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUexVwPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:06:01 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf39f13-4ef5-4464-86c3-c0da20cdc929]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963, portal: 172.16.0.220,3260]
Nov 11 02:06:01 user nova-compute[75215]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963, portal: 172.16.0.220,3260] successful.
Nov 11 02:06:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f8cf674-6161-41b7-986c-2f3f32e47963 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4dbe4b-dc1b-4f42-8d91-b9e2fe0d46bf]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== disconnect_volume: return (315ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:06:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Deleting instance files /opt/stack/data/nova/instances/0980ed55-1b00-458d-abe1-19715c5a23dd_del
Nov 11 02:06:01 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Deletion of /opt/stack/data/nova/instances/0980ed55-1b00-458d-abe1-19715c5a23dd_del complete
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.064s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4871fd18-3cf0-460e-86cc-b54c33a9c368]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:06:01 user nova-compute[75215]: No targets found.
Nov 11 02:06:01 user nova-compute[75215]: iSNS:
Nov 11 02:06:01 user nova-compute[75215]: No targets found.
Nov 11 02:06:01 user nova-compute[75215]: STATIC:
Nov 11 02:06:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e
Nov 11 02:06:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:01 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1
Nov 11 02:06:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:01 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:01 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a
Nov 11 02:06:01 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:01 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:01 user nova-compute[75215]: FIRMWARE:
Nov 11 02:06:01 user nova-compute[75215]: No targets found.
Nov 11 02:06:01 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:06:01 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:06:01 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:06:01 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dd5291-8ff5-429c-b208-19d401125813]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e6ea0-004d-408d-b577-2a8a1d820cb5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:06:02 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:06:02 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:06:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:06:02 user nova-compute[75215]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a (non-flash)
Nov 11 02:06:02 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:06:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40442539a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[991eb288-2855-478f-9059-e061f848ae1d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: INFO nova.compute.manager [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ac3736-c70a-4f7e-af6f-68b37e724a42]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaff3632-d6e7-4e52-a5c3-cdb69b6c3f7c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6b8439-cc2a-42f8-bfc9-ca480038bd34]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aa9ef0-d2eb-4ffa-a4f0-d290abefd588]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cef0083-46ab-4093-ad3c-eb3dcd4648e1]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a, portal: 172.16.0.220,3260]
Nov 11 02:06:02 user nova-compute[75215]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a, portal: 172.16.0.220,3260] successful.
Nov 11 02:06:02 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c87df04-4307-48ab-bc14-93633b6fc80d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] <== disconnect_volume: return (376ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:06:02 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:06:02 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Took 0.70 seconds to deallocate network for instance.
Nov 11 02:06:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-0af3b1fb-9c51-4bc6-9fa3-6ce95e2faf0b req-cc952371-bd37-4103-8cc8-4d1058c421e4 service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received event network-vif-deleted-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-19dc17e8-6b02-422b-b2a5-9de3f39be2b6 req-675bf302-563c-457b-8431-1354308c5acd service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received event network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19dc17e8-6b02-422b-b2a5-9de3f39be2b6 req-675bf302-563c-457b-8431-1354308c5acd service nova] Acquiring lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19dc17e8-6b02-422b-b2a5-9de3f39be2b6 req-675bf302-563c-457b-8431-1354308c5acd service nova] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-19dc17e8-6b02-422b-b2a5-9de3f39be2b6 req-675bf302-563c-457b-8431-1354308c5acd service nova] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-19dc17e8-6b02-422b-b2a5-9de3f39be2b6 req-675bf302-563c-457b-8431-1354308c5acd service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] No waiting events found dispatching network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:03 user nova-compute[75215]: WARNING nova.compute.manager [req-19dc17e8-6b02-422b-b2a5-9de3f39be2b6 req-675bf302-563c-457b-8431-1354308c5acd service nova] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Received unexpected event network-vif-plugged-c6b0fd4c-ae5e-4282-8b4b-ffd55369aff7 for instance with vm_state active and task_state deleting.
Nov 11 02:06:03 user nova-compute[75215]: DEBUG nova.objects.instance [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'flavor' on Instance uuid 6696ee6b-11f3-45b1-b023-558ab78db2fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-9640646c-ad90-4843-8b5f-c3c4d20a3f21 tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.994s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.855s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:03 user nova-compute[75215]: INFO nova.compute.manager [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Terminating instance
Nov 11 02:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:03 user nova-compute[75215]: INFO nova.compute.manager [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Took 1.17 seconds to detach 1 volumes for instance.
Nov 11 02:06:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 0980ed55-1b00-458d-abe1-19715c5a23dd] Deleting volume: 0f8cf674-6161-41b7-986c-2f3f32e47963 {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Instance destroyed successfully.
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lazy-loading 'resources' on Instance uuid 6696ee6b-11f3-45b1-b023-558ab78db2fd {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-165983051',display_name='tempest-VolumesSnapshotTestJSON-instance-165983051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-165983051',id=45,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3u5YFdA2U1aPTNmV4pbOHswzyelItH34kjZhwnKdwyGYi375S+nnG0UizI+PkE0+rBiRfy5XwfhTcLBLB+TVgatkDdX6WsFWAK9+I5h22Sn43XGsqaqsZ/dAOIu2AD6Q==',key_name='tempest-keypair-1285395285',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:01:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1d8b6989b5d40399667cb0b36e0caab',ramdisk_id='',reservation_id='r-oykce6ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-95388186',owner_user_name='tempest-VolumesSnapshotTestJSON-95388186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e69b0fcf8943a4b3fcb905fb7e02b1',uuid=6696ee6b-11f3-45b1-b023-558ab78db2fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converting VIF {"id": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "address": "fa:16:3e:6b:ef:6d", "network": {"id": "6c62e9a3-25c7-4b09-8b77-798baaec11bd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-542872690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8b6989b5d40399667cb0b36e0caab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa87a4b-a5", "ovs_interfaceid": "afa87a4b-a5f1-4503-82ef-137ba0083bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ef:6d,bridge_name='br-int',has_traffic_filtering=True,id=afa87a4b-a5f1-4503-82ef-137ba0083bc0,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa87a4b-a5') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_vif [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ef:6d,bridge_name='br-int',has_traffic_filtering=True,id=afa87a4b-a5f1-4503-82ef-137ba0083bc0,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa87a4b-a5') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafa87a4b-a5, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11b6f32a-bba8-48bf-9452-fc3bd2669e55) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:04 user nova-compute[75215]: INFO os_vif [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ef:6d,bridge_name='br-int',has_traffic_filtering=True,id=afa87a4b-a5f1-4503-82ef-137ba0083bc0,network=Network(6c62e9a3-25c7-4b09-8b77-798baaec11bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa87a4b-a5')
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUexVwPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:06:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[482026e9-0e43-44c1-92ab-3147c42d7475]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:06:04 user nova-compute[75215]: No targets found.
Nov 11 02:06:04 user nova-compute[75215]: iSNS:
Nov 11 02:06:04 user nova-compute[75215]: No targets found.
Nov 11 02:06:04 user nova-compute[75215]: STATIC:
Nov 11 02:06:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e
Nov 11 02:06:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1
Nov 11 02:06:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:04 user nova-compute[75215]: FIRMWARE:
Nov 11 02:06:04 user nova-compute[75215]: No targets found.
Nov 11 02:06:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:06:04 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:06:04 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133a5de2-af47-4cfc-a738-9409a015d89a', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0fb182-89d2-4fd2-8ce7-c52d522cb8a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e6cb87-fba3-43d8-aafd-3522c4e10cfb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:06:04 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:06:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:06:04 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:06:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f404435c670>, {}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Disconnecting from: [] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] <== disconnect_volume: return (95ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:06:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Deleting instance files /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd_del
Nov 11 02:06:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Deletion of /opt/stack/data/nova/instances/6696ee6b-11f3-45b1-b023-558ab78db2fd_del complete
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:06:04 user nova-compute[75215]: INFO nova.compute.manager [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:04 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Deleted allocations for instance 0980ed55-1b00-458d-abe1-19715c5a23dd
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f0859928-b199-4703-bce4-66ee4aaf2a8c tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "0980ed55-1b00-458d-abe1-19715c5a23dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.726s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:06:05 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Took 0.86 seconds to deallocate network for instance.
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-c9da16f7-a3b6-4591-8755-8adf996f58ef req-8df394fa-4247-49b3-bb07-53af8dc9016f service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-deleted-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:05 user nova-compute[75215]: INFO nova.compute.manager [req-c9da16f7-a3b6-4591-8755-8adf996f58ef req-8df394fa-4247-49b3-bb07-53af8dc9016f service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Neutron deleted interface afa87a4b-a5f1-4503-82ef-137ba0083bc0; detaching it from the instance and deleting it from the info cache
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.network.neutron [req-c9da16f7-a3b6-4591-8755-8adf996f58ef req-8df394fa-4247-49b3-bb07-53af8dc9016f service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-unplugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] No waiting events found dispatching network-vif-unplugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-unplugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] No waiting events found dispatching network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:05 user nova-compute[75215]: WARNING nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received unexpected event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 for instance with vm_state active and task_state deleting.
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] No waiting events found dispatching network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:05 user nova-compute[75215]: WARNING nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received unexpected event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 for instance with vm_state active and task_state deleting.
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] No waiting events found dispatching network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:05 user nova-compute[75215]: WARNING nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received unexpected event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 for instance with vm_state active and task_state deleting.
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-unplugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] No waiting events found dispatching network-vif-unplugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-unplugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Acquiring lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] No waiting events found dispatching network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:05 user nova-compute[75215]: WARNING nova.compute.manager [req-e61091f4-f413-493b-b8b3-e04637290113 req-879de5ef-5809-4dc7-9e2f-1432766c1172 service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Received unexpected event network-vif-plugged-afa87a4b-a5f1-4503-82ef-137ba0083bc0 for instance with vm_state active and task_state deleting.
Nov 11 02:06:05 user nova-compute[75215]: WARNING nova.volume.cinder [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Attachment 4ac719f3-a116-4cb2-af62-a0faf52cd595 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4ac719f3-a116-4cb2-af62-a0faf52cd595. (HTTP 404) (Request-ID: req-b64aeabd-9590-4884-8cc6-05ab50707ab8)
Nov 11 02:06:05 user nova-compute[75215]: INFO nova.compute.manager [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Took 0.03 seconds to detach 1 volumes for instance.
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.manager [req-c9da16f7-a3b6-4591-8755-8adf996f58ef req-8df394fa-4247-49b3-bb07-53af8dc9016f service nova] [instance: 6696ee6b-11f3-45b1-b023-558ab78db2fd] Detach interface failed, port_id=afa87a4b-a5f1-4503-82ef-137ba0083bc0, reason: Instance 6696ee6b-11f3-45b1-b023-558ab78db2fd could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:05 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Deleted allocations for instance 6696ee6b-11f3-45b1-b023-558ab78db2fd
Nov 11 02:06:05 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-3cfed232-7303-4fe2-8ef9-873c4bca34af tempest-VolumesSnapshotTestJSON-95388186 tempest-VolumesSnapshotTestJSON-95388186-project-member] Lock "6696ee6b-11f3-45b1-b023-558ab78db2fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.256s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 7957c525-01f2-4fbb-924d-78294385345a {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 2d5bf74a-2b67-4210-b3df-709f11ca6799 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "7957c525-01f2-4fbb-924d-78294385345a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "7957c525-01f2-4fbb-924d-78294385345a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "7957c525-01f2-4fbb-924d-78294385345a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:06:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:06:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:06:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=25.1419677734375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 2d5bf74a-2b67-4210-b3df-709f11ca6799 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5728a539-e1b8-4ee4-b04e-7cbb956cc40d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:06:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:06:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:06:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:06:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 7957c525-01f2-4fbb-924d-78294385345a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updating instance_info_cache with network_info: [{"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:06:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:06:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:06:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:06:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-f83e14da-37d3-47cf-a080-187f9886ddfd req-2ccec8da-a699-4720-ae9a-140b35171614 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-f83e14da-37d3-47cf-a080-187f9886ddfd req-2ccec8da-a699-4720-ae9a-140b35171614 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing instance network info cache due to event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f83e14da-37d3-47cf-a080-187f9886ddfd req-2ccec8da-a699-4720-ae9a-140b35171614 service nova] Acquiring lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f83e14da-37d3-47cf-a080-187f9886ddfd req-2ccec8da-a699-4720-ae9a-140b35171614 service nova] Acquired lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-f83e14da-37d3-47cf-a080-187f9886ddfd req-2ccec8da-a699-4720-ae9a-140b35171614 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-f83e14da-37d3-47cf-a080-187f9886ddfd req-2ccec8da-a699-4720-ae9a-140b35171614 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updated VIF entry in instance network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG nova.network.neutron [req-f83e14da-37d3-47cf-a080-187f9886ddfd req-2ccec8da-a699-4720-ae9a-140b35171614 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f83e14da-37d3-47cf-a080-187f9886ddfd req-2ccec8da-a699-4720-ae9a-140b35171614 service nova] Releasing lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:55 user nova-compute[75215]: INFO nova.compute.manager [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Shelve offloading
Nov 11 02:06:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc207429-ac5d-4d5e-9bbe-5349a5c6a721 req-1ebcf80c-f385-4db3-b4b8-64a199568bbc service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-unplugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc207429-ac5d-4d5e-9bbe-5349a5c6a721 req-1ebcf80c-f385-4db3-b4b8-64a199568bbc service nova] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc207429-ac5d-4d5e-9bbe-5349a5c6a721 req-1ebcf80c-f385-4db3-b4b8-64a199568bbc service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-cc207429-ac5d-4d5e-9bbe-5349a5c6a721 req-1ebcf80c-f385-4db3-b4b8-64a199568bbc service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-cc207429-ac5d-4d5e-9bbe-5349a5c6a721 req-1ebcf80c-f385-4db3-b4b8-64a199568bbc service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] No waiting events found dispatching network-vif-unplugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:56 user nova-compute[75215]: WARNING nova.compute.manager [req-cc207429-ac5d-4d5e-9bbe-5349a5c6a721 req-1ebcf80c-f385-4db3-b4b8-64a199568bbc service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received unexpected event network-vif-unplugged-c34bf040-7798-4da0-a95e-3c8569f9b815 for instance with vm_state active and task_state shelving.
Nov 11 02:06:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:56 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance destroyed successfully.
Nov 11 02:06:56 user nova-compute[75215]: DEBUG nova.compute.manager [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquired lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:06:56 user nova-compute[75215]: DEBUG nova.network.neutron [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.network.neutron [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Releasing lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:06:57 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance destroyed successfully.
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.objects.instance [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lazy-loading 'resources' on Instance uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671404116',display_name='tempest-TestShelveInstance-server-1671404116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671404116',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFfvDPEwJ58zp0oTZPTcZf7TB1Yy6UkEm88Wv/5C2f/phGmTfOfLikqUU065E0kV13kN7pjaZfgxeKJDmn4Kw2VaABAUzwEDEFEEmiMK9UlXKb7pO89B1nOl8lnyEOM5A==',key_name='tempest-TestShelveInstance-580171368',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:05:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7d240f44174c0b9a05c9ab2857a57a',ramdisk_id='',reservation_id='r-esh6lg1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-160686239',owner_user_name='tempest-TestShelveInstance-160686239-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:05:09Z,user_data=None,user_id='5d0f3651de0743eb8cb0b03f2ad9d83b',uuid=5728a539-e1b8-4ee4-b04e-7cbb956cc40d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converting VIF {"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_vif [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc34bf040-77, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76412315-7972-438d-b264-251716e3092d) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-78fb9d98-ada1-4be6-9cf4-fc96da1ed824 req-b15475f1-b67b-4a63-a212-b7ffbb041eee service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.compute.manager [req-78fb9d98-ada1-4be6-9cf4-fc96da1ed824 req-b15475f1-b67b-4a63-a212-b7ffbb041eee service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing instance network info cache due to event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78fb9d98-ada1-4be6-9cf4-fc96da1ed824 req-b15475f1-b67b-4a63-a212-b7ffbb041eee service nova] Acquiring lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78fb9d98-ada1-4be6-9cf4-fc96da1ed824 req-b15475f1-b67b-4a63-a212-b7ffbb041eee service nova] Acquired lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.network.neutron [req-78fb9d98-ada1-4be6-9cf4-fc96da1ed824 req-b15475f1-b67b-4a63-a212-b7ffbb041eee service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:06:57 user nova-compute[75215]: INFO os_vif [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77')
Nov 11 02:06:57 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFdAjbOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:06:57 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab991c5-bfff-47b4-aeb0-c3cf55ef2f1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:06:57 user nova-compute[75215]: No targets found.
Nov 11 02:06:57 user nova-compute[75215]: iSNS:
Nov 11 02:06:57 user nova-compute[75215]: No targets found.
Nov 11 02:06:57 user nova-compute[75215]: STATIC:
Nov 11 02:06:57 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e
Nov 11 02:06:57 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:57 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:57 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1
Nov 11 02:06:57 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:06:57 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:06:57 user nova-compute[75215]: FIRMWARE:
Nov 11 02:06:57 user nova-compute[75215]: No targets found.
Nov 11 02:06:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:06:57 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:06:57 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e47146c-ee9a-4644-9fd6-88fa329feac3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ce7af8-062e-441f-9559-a7557274bfa6]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:06:57 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:06:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:06:57 user nova-compute[75215]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:06:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40442509d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1'): ({'sde'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Removing single pathed devices sde {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3afb22b-e98d-4341-abb9-d275045b8e0a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e42c3-10f7-4b63-abea-5bf57c5cff14]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Flushing IO for device /dev/sde {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f395f048-6abd-4f0d-89c7-6ce79d82125f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[058833dd-c981-4b64-a97c-5895bd911b85]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] SCSI volumes sde have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaacf053-0050-4169-86e3-751ecea91f43]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a9ba54-4a51-4adc-a885-bf4d823e7ad6]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260]
Nov 11 02:06:57 user nova-compute[75215]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260] successful.
Nov 11 02:06:57 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:57 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c08dc31-f2a1-45be-ab38-3b38e8108fbf]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] <== disconnect_volume: return (307ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:06:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Deleting instance files /opt/stack/data/nova/instances/5728a539-e1b8-4ee4-b04e-7cbb956cc40d_del
Nov 11 02:06:58 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Deletion of /opt/stack/data/nova/instances/5728a539-e1b8-4ee4-b04e-7cbb956cc40d_del complete
Nov 11 02:06:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-78fb9d98-ada1-4be6-9cf4-fc96da1ed824 req-b15475f1-b67b-4a63-a212-b7ffbb041eee service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updated VIF entry in instance network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-78fb9d98-ada1-4be6-9cf4-fc96da1ed824 req-b15475f1-b67b-4a63-a212-b7ffbb041eee service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": null, "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc34bf040-77", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-78fb9d98-ada1-4be6-9cf4-fc96da1ed824 req-b15475f1-b67b-4a63-a212-b7ffbb041eee service nova] Releasing lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-5fb8b7ec-c251-493b-9ce2-a1b21a2989a3 req-5437216b-ddcf-4549-88b9-2dfae0b04883 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fb8b7ec-c251-493b-9ce2-a1b21a2989a3 req-5437216b-ddcf-4549-88b9-2dfae0b04883 service nova] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fb8b7ec-c251-493b-9ce2-a1b21a2989a3 req-5437216b-ddcf-4549-88b9-2dfae0b04883 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fb8b7ec-c251-493b-9ce2-a1b21a2989a3 req-5437216b-ddcf-4549-88b9-2dfae0b04883 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-5fb8b7ec-c251-493b-9ce2-a1b21a2989a3 req-5437216b-ddcf-4549-88b9-2dfae0b04883 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] No waiting events found dispatching network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:06:58 user nova-compute[75215]: WARNING nova.compute.manager [req-5fb8b7ec-c251-493b-9ce2-a1b21a2989a3 req-5437216b-ddcf-4549-88b9-2dfae0b04883 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received unexpected event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 for instance with vm_state active and task_state shelving.
Nov 11 02:06:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:06:59 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Deleted allocations for instance 5728a539-e1b8-4ee4-b04e-7cbb956cc40d
Nov 11 02:06:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:06:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:06:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lazy-loading 'numa_topology' on Instance uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:06:59 user nova-compute[75215]: DEBUG nova.objects.base [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Object Instance<5728a539-e1b8-4ee4-b04e-7cbb956cc40d> lazy-loaded attributes: resources,numa_topology {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 02:06:59 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:06:59 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:06:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:06:59 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-80ea057a-7e47-44c6-a8f1-d71036ba8527 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.542s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:07:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:07:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:07:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:07:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:07:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:07:03 user nova-compute[75215]: INFO nova.compute.manager [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Terminating instance
Nov 11 02:07:03 user nova-compute[75215]: DEBUG nova.compute.manager [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:07:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:03 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-b860eee0-c773-4607-8a56-3568535e8429 req-ee29050d-36ff-4ca4-8c2f-814fa963c7f1 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received event network-vif-unplugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b860eee0-c773-4607-8a56-3568535e8429 req-ee29050d-36ff-4ca4-8c2f-814fa963c7f1 service nova] Acquiring lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b860eee0-c773-4607-8a56-3568535e8429 req-ee29050d-36ff-4ca4-8c2f-814fa963c7f1 service nova] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b860eee0-c773-4607-8a56-3568535e8429 req-ee29050d-36ff-4ca4-8c2f-814fa963c7f1 service nova] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-b860eee0-c773-4607-8a56-3568535e8429 req-ee29050d-36ff-4ca4-8c2f-814fa963c7f1 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] No waiting events found dispatching network-vif-unplugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-b860eee0-c773-4607-8a56-3568535e8429 req-ee29050d-36ff-4ca4-8c2f-814fa963c7f1 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received event network-vif-unplugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:07:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Instance destroyed successfully.
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.objects.instance [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'resources' on Instance uuid 2d5bf74a-2b67-4210-b3df-709f11ca6799 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-200025765',display_name='tempest-TestVolumeBootPattern-volume-backed-server-200025765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-200025765',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELR0acTfIlG5bET4VSAT21jITEMov+pRn8JenOPCqHN2afbMsp55CP9Qe5a1l9wHD7YGzG9fpr4D2D1EOGooJVyR2kNex3R9mOIiG7vRo6qJO/zYWBWE/tqfv7QyOgLDw==',key_name='tempest-keypair-489132160',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:02:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-udh2fm70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195d763c024c4db99be056d17d243171',uuid=2d5bf74a-2b67-4210-b3df-709f11ca6799,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "address": "fa:16:3e:10:18:51", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap257f8f7a-a8", "ovs_interfaceid": "257f8f7a-a8b9-41fc-9410-1f6857a86f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:51,bridge_name='br-int',has_traffic_filtering=True,id=257f8f7a-a8b9-41fc-9410-1f6857a86f73,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257f8f7a-a8') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_vif [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:51,bridge_name='br-int',has_traffic_filtering=True,id=257f8f7a-a8b9-41fc-9410-1f6857a86f73,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257f8f7a-a8') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap257f8f7a-a8, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6d2a477-19b2-4e01-a4c4-b84a0df4dcd6) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:04 user nova-compute[75215]: INFO os_vif [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:18:51,bridge_name='br-int',has_traffic_filtering=True,id=257f8f7a-a8b9-41fc-9410-1f6857a86f73,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap257f8f7a-a8')
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBFuiYJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:07:04 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3644b89-13ef-4f40-8b5e-f1ca3d0d5fb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:07:04 user nova-compute[75215]: No targets found.
Nov 11 02:07:04 user nova-compute[75215]: iSNS:
Nov 11 02:07:04 user nova-compute[75215]: No targets found.
Nov 11 02:07:04 user nova-compute[75215]: STATIC:
Nov 11 02:07:04 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e
Nov 11 02:07:04 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:07:04 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:07:04 user nova-compute[75215]: FIRMWARE:
Nov 11 02:07:04 user nova-compute[75215]: No targets found.
Nov 11 02:07:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:07:04 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:07:04 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e576d6c-db40-4c90-88cc-e76fb5d25a97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e03d34-2b9b-4a5f-9e69-b9e13420f6c1]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:07:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e (non-flash)
Nov 11 02:07:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4044536dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[967f5057-1262-408b-8e07-086b5f1b420d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f0710-b01b-49b2-be91-52c088e110b9]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[728dd06d-d99d-4bbc-ae7d-19e7b7f1d5a8]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2447b984-a6bf-4115-9fa8-5eb8b7a58606]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eb9001-dfcf-4ae6-af72-31f5808b5574]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87656a-0476-42f2-a5a6-6be7e98bc53b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e, portal: 172.16.0.220,3260]
Nov 11 02:07:04 user nova-compute[75215]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e, portal: 172.16.0.220,3260] successful.
Nov 11 02:07:04 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a080488a-4a20-444c-99e0-4163f689692e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5c230-2ebf-4725-bc42-29b5fe3027d4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== disconnect_volume: return (304ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:07:04 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:07:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Deleting instance files /opt/stack/data/nova/instances/2d5bf74a-2b67-4210-b3df-709f11ca6799_del
Nov 11 02:07:04 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Deletion of /opt/stack/data/nova/instances/2d5bf74a-2b67-4210-b3df-709f11ca6799_del complete
Nov 11 02:07:05 user nova-compute[75215]: INFO nova.compute.manager [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 11 02:07:05 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:07:05 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:07:05 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:07:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:05 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:07:05 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Took 0.70 seconds to deallocate network for instance.
Nov 11 02:07:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-3512fb5c-9ac0-4c2c-a24e-3f93b27ddb65 req-abea3a31-62b0-45d7-9b74-6b6f622adef8 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received event network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3512fb5c-9ac0-4c2c-a24e-3f93b27ddb65 req-abea3a31-62b0-45d7-9b74-6b6f622adef8 service nova] Acquiring lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3512fb5c-9ac0-4c2c-a24e-3f93b27ddb65 req-abea3a31-62b0-45d7-9b74-6b6f622adef8 service nova] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-3512fb5c-9ac0-4c2c-a24e-3f93b27ddb65 req-abea3a31-62b0-45d7-9b74-6b6f622adef8 service nova] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:07:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-3512fb5c-9ac0-4c2c-a24e-3f93b27ddb65 req-abea3a31-62b0-45d7-9b74-6b6f622adef8 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] No waiting events found dispatching network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:07:06 user nova-compute[75215]: WARNING nova.compute.manager [req-3512fb5c-9ac0-4c2c-a24e-3f93b27ddb65 req-abea3a31-62b0-45d7-9b74-6b6f622adef8 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received unexpected event network-vif-plugged-257f8f7a-a8b9-41fc-9410-1f6857a86f73 for instance with vm_state active and task_state deleting.
Nov 11 02:07:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-3512fb5c-9ac0-4c2c-a24e-3f93b27ddb65 req-abea3a31-62b0-45d7-9b74-6b6f622adef8 service nova] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Received event network-vif-deleted-257f8f7a-a8b9-41fc-9410-1f6857a86f73 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:07:06 user nova-compute[75215]: INFO nova.compute.manager [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Took 0.98 seconds to detach 1 volumes for instance.
Nov 11 02:07:06 user nova-compute[75215]: DEBUG nova.compute.manager [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 2d5bf74a-2b67-4210-b3df-709f11ca6799] Deleting volume: a080488a-4a20-444c-99e0-4163f689692e {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 02:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:07:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:07:07 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:07:07 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:07:07 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Deleted allocations for instance 2d5bf74a-2b67-4210-b3df-709f11ca6799
Nov 11 02:07:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-17fac73b-0366-4dba-839d-294271028b42 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "2d5bf74a-2b67-4210-b3df-709f11ca6799" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.438s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:07:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:07:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:07:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:07:34 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:07:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:07:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:07:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.132221221923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:07:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:07:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:07:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:07:43 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:07:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:07:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:07:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:07:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:07:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:07:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:07:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:07:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 11 02:07:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 02:07:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:07:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:07:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:07:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:07:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:07:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:07:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:07:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:07:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:07:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:08:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "f7d78636-cf35-488c-978c-fc475a161a06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:08:16 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "f7d78636-cf35-488c-978c-fc475a161a06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:08:17 user nova-compute[75215]: INFO nova.compute.claims [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Claim successful on node user
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 02:08:17 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 02:08:17 user nova-compute[75215]: INFO nova.virt.block_device [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Booting with volume bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 at /dev/vda
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.policy [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '195d763c024c4db99be056d17d243171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5a366788b744f9b121b9e946ff230f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG os_brick.utils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[018db739-d193-47ca-8c6d-b39467c37906]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f03aaf5-ab67-48d4-bb06-ab06c077d9b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[edadabe9-3cda-4c63-8a8b-0988dc88b9b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2f8f28-ed06-453a-bc4c-3b8b95122cfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:08:17 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:08:17 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4c4cf4-f4e4-4996-8e22-ae2b55916304]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG os_brick.utils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:08:17 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updating existing volume attachment record: a634854f-3d65-401e-8657-1c943f5b199c {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:08:18 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Successfully created port: 697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Successfully updated port: 697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquired lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-b25aff52-c1a3-46e1-8bde-2c68dcee7c2c req-4da39453-7b81-4b33-aa0b-87d9026ab807 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received event network-changed-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG nova.compute.manager [req-b25aff52-c1a3-46e1-8bde-2c68dcee7c2c req-4da39453-7b81-4b33-aa0b-87d9026ab807 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Refreshing instance network info cache due to event network-changed-697a9f11-8a6f-44b6-a3e9-cc7384244fd4. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b25aff52-c1a3-46e1-8bde-2c68dcee7c2c req-4da39453-7b81-4b33-aa0b-87d9026ab807 service nova] Acquiring lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG nova.network.neutron [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updating instance_info_cache with network_info: [{"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Releasing lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Instance network_info: |[{"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b25aff52-c1a3-46e1-8bde-2c68dcee7c2c req-4da39453-7b81-4b33-aa0b-87d9026ab807 service nova] Acquired lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG nova.network.neutron [req-b25aff52-c1a3-46e1-8bde-2c68dcee7c2c req-4da39453-7b81-4b33-aa0b-87d9026ab807 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Refreshing network info cache for port 697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:08:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:08:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-b25aff52-c1a3-46e1-8bde-2c68dcee7c2c req-4da39453-7b81-4b33-aa0b-87d9026ab807 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updated VIF entry in instance network info cache for port 697a9f11-8a6f-44b6-a3e9-cc7384244fd4. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:08:20 user nova-compute[75215]: DEBUG nova.network.neutron [req-b25aff52-c1a3-46e1-8bde-2c68dcee7c2c req-4da39453-7b81-4b33-aa0b-87d9026ab807 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updating instance_info_cache with network_info: [{"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:08:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b25aff52-c1a3-46e1-8bde-2c68dcee7c2c req-4da39453-7b81-4b33-aa0b-87d9026ab807 service nova] Releasing lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:08:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:35 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:08:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:08:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8840MB free_disk=25.13003158569336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 7957c525-01f2-4fbb-924d-78294385345a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance f7d78636-cf35-488c-978c-fc475a161a06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:08:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:08:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:08:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:08:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:08:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:08:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:08:42 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Creating image(s)
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Ensure instance console log exists: /opt/stack/data/nova/instances/f7d78636-cf35-488c-978c-fc475a161a06/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Start _get_guest_xml network_info=[{"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'a634854f-3d65-401e-8657-1c943f5b199c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKuREMTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7d78636-cf35-488c-978c-fc475a161a06', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'serial': 'bf9e5fb2-187e-4933-a4fa-b28822c8f6a1'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:08:42 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:08:42 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKuREMTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:08:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:08:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:08:42 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82e5792-35c3-4e7b-a776-9b540ad397ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:08:42 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369aa0d-2ac4-4d64-8d32-9f38bae35b06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1] added
Nov 11 02:08:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b118c512-8bdb-4f7d-af57-d4f95191d06c]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0152c4af-4618-431f-b6d6-ae3d271ea215]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKuREMTp {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKuREMTp" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eed0a9-2d4a-4645-9510-c1bc6de13345]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OKuREMTp'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb91e45-6d61-4b81-bf68-a68b55be300b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fe02ed-7a38-4413-8cf8-0ba9b3204c3a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 02:08:42 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 02:08:42 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:08:42 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 02:08:42 user nova-compute[75215]: 
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bade7e-4d9b-4e27-bfa3-47d732183720]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260]
Nov 11 02:08:42 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260] successful.
Nov 11 02:08:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2020924-086f-4cce-aaaf-3d7c598babd0]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cec6403-b531-4534-a084-0a455e457029]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:08:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:08:42 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b1fbca-c0c8-4abd-9faf-2b59585cb7b2]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:42 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKuREMTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26332613838613364', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332613838613364', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-247836696',display_name='tempest-TestVolumeBootPattern-server-247836696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-247836696',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-5a3y91z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:08:18Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=f7d78636-cf35-488c-978c-fc475a161a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:3d,bridge_name='br-int',has_traffic_filtering=True,id=697a9f11-8a6f-44b6-a3e9-cc7384244fd4,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697a9f11-8a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.objects.instance [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'pci_devices' on Instance uuid f7d78636-cf35-488c-978c-fc475a161a06 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:08:43 user nova-compute[75215]:   <uuid>f7d78636-cf35-488c-978c-fc475a161a06</uuid>
Nov 11 02:08:43 user nova-compute[75215]:   <name>instance-00000032</name>
Nov 11 02:08:43 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:08:43 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:08:43 user nova-compute[75215]:   <metadata>
Nov 11 02:08:43 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:08:43 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:08:43 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-server-247836696</nova:name>
Nov 11 02:08:43 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:08:42</nova:creationTime>
Nov 11 02:08:43 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:08:43 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:08:43 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:08:43 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:08:43 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:08:43 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:08:43 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:08:43 user nova-compute[75215]:       <nova:owner>
Nov 11 02:08:43 user nova-compute[75215]:         <nova:user uuid="195d763c024c4db99be056d17d243171">tempest-TestVolumeBootPattern-1487726842-project-member</nova:user>
Nov 11 02:08:43 user nova-compute[75215]:         <nova:project uuid="ca5a366788b744f9b121b9e946ff230f">tempest-TestVolumeBootPattern-1487726842</nova:project>
Nov 11 02:08:43 user nova-compute[75215]:       </nova:owner>
Nov 11 02:08:43 user nova-compute[75215]:       <nova:ports>
Nov 11 02:08:43 user nova-compute[75215]:         <nova:port uuid="697a9f11-8a6f-44b6-a3e9-cc7384244fd4">
Nov 11 02:08:43 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 02:08:43 user nova-compute[75215]:         </nova:port>
Nov 11 02:08:43 user nova-compute[75215]:       </nova:ports>
Nov 11 02:08:43 user nova-compute[75215]:     </nova:instance>
Nov 11 02:08:43 user nova-compute[75215]:   </metadata>
Nov 11 02:08:43 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:08:43 user nova-compute[75215]:     <system>
Nov 11 02:08:43 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:08:43 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:08:43 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:08:43 user nova-compute[75215]:       <entry name="serial">f7d78636-cf35-488c-978c-fc475a161a06</entry>
Nov 11 02:08:43 user nova-compute[75215]:       <entry name="uuid">f7d78636-cf35-488c-978c-fc475a161a06</entry>
Nov 11 02:08:43 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:08:43 user nova-compute[75215]:     </system>
Nov 11 02:08:43 user nova-compute[75215]:   </sysinfo>
Nov 11 02:08:43 user nova-compute[75215]:   <os>
Nov 11 02:08:43 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:08:43 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:08:43 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:08:43 user nova-compute[75215]:   </os>
Nov 11 02:08:43 user nova-compute[75215]:   <features>
Nov 11 02:08:43 user nova-compute[75215]:     <acpi/>
Nov 11 02:08:43 user nova-compute[75215]:     <apic/>
Nov 11 02:08:43 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:08:43 user nova-compute[75215]:   </features>
Nov 11 02:08:43 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:08:43 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:08:43 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:08:43 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:08:43 user nova-compute[75215]:   </clock>
Nov 11 02:08:43 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:08:43 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:08:43 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:08:43 user nova-compute[75215]:   </cpu>
Nov 11 02:08:43 user nova-compute[75215]:   <devices>
Nov 11 02:08:43 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 02:08:43 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:08:43 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 11 02:08:43 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:08:43 user nova-compute[75215]:       <serial>bf9e5fb2-187e-4933-a4fa-b28822c8f6a1</serial>
Nov 11 02:08:43 user nova-compute[75215]:     </disk>
Nov 11 02:08:43 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:08:43 user nova-compute[75215]:       <mac address="fa:16:3e:73:11:3d"/>
Nov 11 02:08:43 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:08:43 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:08:43 user nova-compute[75215]:       <target dev="tap697a9f11-8a"/>
Nov 11 02:08:43 user nova-compute[75215]:     </interface>
Nov 11 02:08:43 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:08:43 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/f7d78636-cf35-488c-978c-fc475a161a06/console.log" append="off"/>
Nov 11 02:08:43 user nova-compute[75215]:     </serial>
Nov 11 02:08:43 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:08:43 user nova-compute[75215]:     <video>
Nov 11 02:08:43 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:08:43 user nova-compute[75215]:     </video>
Nov 11 02:08:43 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:08:43 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:08:43 user nova-compute[75215]:     </rng>
Nov 11 02:08:43 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:08:43 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:08:43 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:08:43 user nova-compute[75215]:     </memballoon>
Nov 11 02:08:43 user nova-compute[75215]:   </devices>
Nov 11 02:08:43 user nova-compute[75215]: </domain>
Nov 11 02:08:43 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-247836696',display_name='tempest-TestVolumeBootPattern-server-247836696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-247836696',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-5a3y91z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:08:18Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=f7d78636-cf35-488c-978c-fc475a161a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:3d,bridge_name='br-int',has_traffic_filtering=True,id=697a9f11-8a6f-44b6-a3e9-cc7384244fd4,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697a9f11-8a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG os_vif [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:3d,bridge_name='br-int',has_traffic_filtering=True,id=697a9f11-8a6f-44b6-a3e9-cc7384244fd4,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697a9f11-8a') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d518551-ee92-5e04-a083-8848e1f45147', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap697a9f11-8a, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap697a9f11-8a, col_values=(('qos', UUID('46a2f983-ba1f-4982-84a2-2d9d60bf8640')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap697a9f11-8a, col_values=(('external_ids', {'iface-id': '697a9f11-8a6f-44b6-a3e9-cc7384244fd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:11:3d', 'vm-uuid': 'f7d78636-cf35-488c-978c-fc475a161a06'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:43 user nova-compute[75215]: INFO os_vif [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:3d,bridge_name='br-int',has_traffic_filtering=True,id=697a9f11-8a6f-44b6-a3e9-cc7384244fd4,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697a9f11-8a')
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:08:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No VIF found with MAC fa:16:3e:73:11:3d, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-fc930d86-331b-45af-858c-380e71a1ab39 req-7668c908-8671-46b7-aa59-6ca09aad95d0 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received event network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fc930d86-331b-45af-858c-380e71a1ab39 req-7668c908-8671-46b7-aa59-6ca09aad95d0 service nova] Acquiring lock "f7d78636-cf35-488c-978c-fc475a161a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fc930d86-331b-45af-858c-380e71a1ab39 req-7668c908-8671-46b7-aa59-6ca09aad95d0 service nova] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-fc930d86-331b-45af-858c-380e71a1ab39 req-7668c908-8671-46b7-aa59-6ca09aad95d0 service nova] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG nova.compute.manager [req-fc930d86-331b-45af-858c-380e71a1ab39 req-7668c908-8671-46b7-aa59-6ca09aad95d0 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] No waiting events found dispatching network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:08:45 user nova-compute[75215]: WARNING nova.compute.manager [req-fc930d86-331b-45af-858c-380e71a1ab39 req-7668c908-8671-46b7-aa59-6ca09aad95d0 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received unexpected event network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 for instance with vm_state building and task_state spawning.
Nov 11 02:08:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:46 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:08:47 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Instance spawned successfully.
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-c4095a24-f772-4176-930a-4e11f48323e0 req-0d32c4e3-ff9c-485a-a833-967f171bd9f3 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received event network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c4095a24-f772-4176-930a-4e11f48323e0 req-0d32c4e3-ff9c-485a-a833-967f171bd9f3 service nova] Acquiring lock "f7d78636-cf35-488c-978c-fc475a161a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c4095a24-f772-4176-930a-4e11f48323e0 req-0d32c4e3-ff9c-485a-a833-967f171bd9f3 service nova] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c4095a24-f772-4176-930a-4e11f48323e0 req-0d32c4e3-ff9c-485a-a833-967f171bd9f3 service nova] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.compute.manager [req-c4095a24-f772-4176-930a-4e11f48323e0 req-0d32c4e3-ff9c-485a-a833-967f171bd9f3 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] No waiting events found dispatching network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:08:47 user nova-compute[75215]: WARNING nova.compute.manager [req-c4095a24-f772-4176-930a-4e11f48323e0 req-0d32c4e3-ff9c-485a-a833-967f171bd9f3 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received unexpected event network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 for instance with vm_state building and task_state spawning.
Nov 11 02:08:47 user nova-compute[75215]: INFO nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 11 02:08:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:08:47 user nova-compute[75215]: INFO nova.compute.manager [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Took 30.37 seconds to build instance.
Nov 11 02:08:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-8c1010c8-318b-46d5-8b6f-1c41368b711f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "f7d78636-cf35-488c-978c-fc475a161a06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.715s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:08:47 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:08:47 user nova-compute[75215]: INFO nova.compute.manager [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Unshelving
Nov 11 02:08:48 user nova-compute[75215]: INFO nova.virt.block_device [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Booting with volume 94520099-7b8e-42c7-849f-b42dd84785f1 at /dev/vda
Nov 11 02:08:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f99ea4-9dc9-435f-b748-fc12647dc824]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c6def-09b0-4605-a060-0d15eb0620dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[67075649-4619-46b3-9e18-809de18aa6e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4266c7c-6a06-4dcd-bb37-af9d9115b2e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:08:48 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:08:48 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca9f69-0c54-4728-a56d-ae5bad139afe]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG os_brick.utils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating existing volume attachment record: c8cf419e-3ba8-4c7f-b082-5d4bc4c2819a {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:08:48 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:08:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:08:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:08:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:08:49 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:08:49 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid 7957c525-01f2-4fbb-924d-78294385345a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:08:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updating instance_info_cache with network_info: [{"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:08:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-7957c525-01f2-4fbb-924d-78294385345a" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:08:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:08:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:08:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:08:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "7957c525-01f2-4fbb-924d-78294385345a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "7957c525-01f2-4fbb-924d-78294385345a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "7957c525-01f2-4fbb-924d-78294385345a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:01 user nova-compute[75215]: INFO nova.compute.manager [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Terminating instance
Nov 11 02:09:01 user nova-compute[75215]: DEBUG nova.compute.manager [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-50a8e2bb-8958-474c-9f32-4a6669700128 req-a5b5eb63-6dab-44f1-9893-35b4112e6233 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received event network-vif-unplugged-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-50a8e2bb-8958-474c-9f32-4a6669700128 req-a5b5eb63-6dab-44f1-9893-35b4112e6233 service nova] Acquiring lock "7957c525-01f2-4fbb-924d-78294385345a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-50a8e2bb-8958-474c-9f32-4a6669700128 req-a5b5eb63-6dab-44f1-9893-35b4112e6233 service nova] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-50a8e2bb-8958-474c-9f32-4a6669700128 req-a5b5eb63-6dab-44f1-9893-35b4112e6233 service nova] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-50a8e2bb-8958-474c-9f32-4a6669700128 req-a5b5eb63-6dab-44f1-9893-35b4112e6233 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] No waiting events found dispatching network-vif-unplugged-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.compute.manager [req-50a8e2bb-8958-474c-9f32-4a6669700128 req-a5b5eb63-6dab-44f1-9893-35b4112e6233 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received event network-vif-unplugged-29f942b3-f659-478c-868f-8ffe07ed99e6 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Instance destroyed successfully.
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.objects.instance [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lazy-loading 'resources' on Instance uuid 7957c525-01f2-4fbb-924d-78294385345a {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T01:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-914582135',display_name='tempest-ServersNegativeTestJSON-server-914582135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-914582135',id=44,image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T01:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfd080e37617456483a3f83f48d5811e',ramdisk_id='',reservation_id='r-yhhxovpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ff07f7e9-c859-41fd-adb3-c436d43c7526',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1091055269',owner_user_name='tempest-ServersNegativeTestJSON-1091055269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T01:59:57Z,user_data=None,user_id='faa7793f9ad2446eb57cc512a1972c07',uuid=7957c525-01f2-4fbb-924d-78294385345a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converting VIF {"id": "29f942b3-f659-478c-868f-8ffe07ed99e6", "address": "fa:16:3e:7c:07:88", "network": {"id": "c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-49157639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd080e37617456483a3f83f48d5811e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f942b3-f6", "ovs_interfaceid": "29f942b3-f659-478c-868f-8ffe07ed99e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:07:88,bridge_name='br-int',has_traffic_filtering=True,id=29f942b3-f659-478c-868f-8ffe07ed99e6,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f942b3-f6') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG os_vif [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:07:88,bridge_name='br-int',has_traffic_filtering=True,id=29f942b3-f659-478c-868f-8ffe07ed99e6,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f942b3-f6') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29f942b3-f6, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55a6fd2c-d7dd-465b-83b6-8427126c7d0a) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:02 user nova-compute[75215]: INFO os_vif [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:07:88,bridge_name='br-int',has_traffic_filtering=True,id=29f942b3-f659-478c-868f-8ffe07ed99e6,network=Network(c5dd5c2a-abe5-4c4b-a0a4-f6da022525e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f942b3-f6')
Nov 11 02:09:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Deleting instance files /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a_del
Nov 11 02:09:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Deletion of /opt/stack/data/nova/instances/7957c525-01f2-4fbb-924d-78294385345a_del complete
Nov 11 02:09:02 user nova-compute[75215]: INFO nova.compute.manager [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 11 02:09:02 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 7957c525-01f2-4fbb-924d-78294385345a] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:09:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:09:03 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:09:03 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Took 0.68 seconds to deallocate network for instance.
Nov 11 02:09:03 user nova-compute[75215]: DEBUG nova.compute.manager [req-051f759e-e3cc-4e58-b4f3-c107c668c6a1 req-78820b81-823b-47ff-90a9-a20296002f8c service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received event network-vif-deleted-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:09:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:03 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:09:03 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:09:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:03 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Deleted allocations for instance 7957c525-01f2-4fbb-924d-78294385345a
Nov 11 02:09:03 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26d9d283-9486-4a5c-a418-2a17fcd38d2a tempest-ServersNegativeTestJSON-1091055269 tempest-ServersNegativeTestJSON-1091055269-project-member] Lock "7957c525-01f2-4fbb-924d-78294385345a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-e8edd83d-b387-4c46-b947-1cf27837b69c req-9d59dbf3-230a-4515-8b26-bcfe08dac4a0 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received event network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:09:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8edd83d-b387-4c46-b947-1cf27837b69c req-9d59dbf3-230a-4515-8b26-bcfe08dac4a0 service nova] Acquiring lock "7957c525-01f2-4fbb-924d-78294385345a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8edd83d-b387-4c46-b947-1cf27837b69c req-9d59dbf3-230a-4515-8b26-bcfe08dac4a0 service nova] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e8edd83d-b387-4c46-b947-1cf27837b69c req-9d59dbf3-230a-4515-8b26-bcfe08dac4a0 service nova] Lock "7957c525-01f2-4fbb-924d-78294385345a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-e8edd83d-b387-4c46-b947-1cf27837b69c req-9d59dbf3-230a-4515-8b26-bcfe08dac4a0 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] No waiting events found dispatching network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:09:04 user nova-compute[75215]: WARNING nova.compute.manager [req-e8edd83d-b387-4c46-b947-1cf27837b69c req-9d59dbf3-230a-4515-8b26-bcfe08dac4a0 service nova] [instance: 7957c525-01f2-4fbb-924d-78294385345a] Received unexpected event network-vif-plugged-29f942b3-f659-478c-868f-8ffe07ed99e6 for instance with vm_state deleted and task_state None.
Nov 11 02:09:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:07 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:12 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lazy-loading 'pci_requests' on Instance uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:09:13 user nova-compute[75215]: DEBUG nova.objects.instance [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lazy-loading 'numa_topology' on Instance uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:09:13 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:09:13 user nova-compute[75215]: INFO nova.compute.claims [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Claim successful on node user
Nov 11 02:09:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:09:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:09:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:14 user nova-compute[75215]: INFO nova.network.neutron [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating port c34bf040-7798-4da0-a95e-3c8569f9b815 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 11 02:09:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:09:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquired lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:09:14 user nova-compute[75215]: DEBUG nova.network.neutron [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:09:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-894b2899-7589-4134-aaea-d5e1e4a00b44 req-9a9213e6-06f7-4fec-8706-cc18ce555aaa service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:09:14 user nova-compute[75215]: DEBUG nova.compute.manager [req-894b2899-7589-4134-aaea-d5e1e4a00b44 req-9a9213e6-06f7-4fec-8706-cc18ce555aaa service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing instance network info cache due to event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:09:14 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-894b2899-7589-4134-aaea-d5e1e4a00b44 req-9a9213e6-06f7-4fec-8706-cc18ce555aaa service nova] Acquiring lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.network.neutron [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Releasing lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:09:15 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Creating image(s)
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Ensure instance console log exists: /opt/stack/data/nova/instances/5728a539-e1b8-4ee4-b04e-7cbb956cc40d/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Start _get_guest_xml network_info=[{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'c8cf419e-3ba8-4c7f-b082-5d4bc4c2819a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFdAjbOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5728a539-e1b8-4ee4-b04e-7cbb956cc40d', 'attached_at': '', 'detached_at': '', 'volume_id': '94520099-7b8e-42c7-849f-b42dd84785f1', 'serial': '94520099-7b8e-42c7-849f-b42dd84785f1'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-894b2899-7589-4134-aaea-d5e1e4a00b44 req-9a9213e6-06f7-4fec-8706-cc18ce555aaa service nova] Acquired lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-894b2899-7589-4134-aaea-d5e1e4a00b44 req-9a9213e6-06f7-4fec-8706-cc18ce555aaa service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:09:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:09:15 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.objects.instance [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.objects.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Object Instance<5728a539-e1b8-4ee4-b04e-7cbb956cc40d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFdAjbOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:09:15 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:09:15 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:09:15 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[467db872-5a65-487a-a676-ae948f55f87b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:09:15 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b77dd87-cd49-41c5-aa6a-4d2b8be91ce8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1] added
Nov 11 02:09:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cade4b-7175-4d83-91d1-308ad6e749b1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28e79c5-cb4c-40da-ae47-564726d73e14]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFdAjbOP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFdAjbOP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8953f621-a8be-4de3-be1b-cd1f96889e53]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFdAjbOP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb023f07-4e7a-42d4-831b-61d1879ee3f9]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[68932d41-79a0-4b90-a84a-e6b1dec4e7a9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:09:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:09:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e0ef95-7dd8-4ba3-8c63-6e72e851e4fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260]
Nov 11 02:09:15 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260] successful.
Nov 11 02:09:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[56985c3b-e89e-4ede-8579-67d8beba7c25]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6190dc7f-f7f1-417f-bb95-b73e2b4e1470]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:09:15 user nova-compute[75215]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:09:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:09:15 user nova-compute[75215]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:09:15 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4423c515-3ff4-4523-856f-161ec97c8fec]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFdAjbOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-894b2899-7589-4134-aaea-d5e1e4a00b44 req-9a9213e6-06f7-4fec-8706-cc18ce555aaa service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updated VIF entry in instance network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG nova.network.neutron [req-894b2899-7589-4134-aaea-d5e1e4a00b44 req-9a9213e6-06f7-4fec-8706-cc18ce555aaa service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:09:15 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-894b2899-7589-4134-aaea-d5e1e4a00b44 req-9a9213e6-06f7-4fec-8706-cc18ce555aaa service nova] Releasing lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26334346637623263', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334346637623263', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T02:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671404116',display_name='tempest-TestShelveInstance-server-1671404116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671404116',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-580171368',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:05:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5a7d240f44174c0b9a05c9ab2857a57a',ramdisk_id='',reservation_id='r-esh6lg1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-160686239',owner_user_name='tempest-TestShelveInstance-160686239-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:08:48Z,user_data=None,user_id='5d0f3651de0743eb8cb0b03f2ad9d83b',uuid=5728a539-e1b8-4ee4-b04e-7cbb956cc40d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converting VIF {"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.objects.instance [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lazy-loading 'pci_devices' on Instance uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.objects.base [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Object Instance<5728a539-e1b8-4ee4-b04e-7cbb956cc40d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75215) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:09:16 user nova-compute[75215]:   <uuid>5728a539-e1b8-4ee4-b04e-7cbb956cc40d</uuid>
Nov 11 02:09:16 user nova-compute[75215]:   <name>instance-00000031</name>
Nov 11 02:09:16 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:09:16 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:09:16 user nova-compute[75215]:   <metadata>
Nov 11 02:09:16 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:09:16 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:09:16 user nova-compute[75215]:       <nova:name>tempest-TestShelveInstance-server-1671404116</nova:name>
Nov 11 02:09:16 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:09:15</nova:creationTime>
Nov 11 02:09:16 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:09:16 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:09:16 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:09:16 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:09:16 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:09:16 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:09:16 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:09:16 user nova-compute[75215]:       <nova:owner>
Nov 11 02:09:16 user nova-compute[75215]:         <nova:user uuid="5d0f3651de0743eb8cb0b03f2ad9d83b">tempest-TestShelveInstance-160686239-project-member</nova:user>
Nov 11 02:09:16 user nova-compute[75215]:         <nova:project uuid="5a7d240f44174c0b9a05c9ab2857a57a">tempest-TestShelveInstance-160686239</nova:project>
Nov 11 02:09:16 user nova-compute[75215]:       </nova:owner>
Nov 11 02:09:16 user nova-compute[75215]:       <nova:ports>
Nov 11 02:09:16 user nova-compute[75215]:         <nova:port uuid="c34bf040-7798-4da0-a95e-3c8569f9b815">
Nov 11 02:09:16 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 02:09:16 user nova-compute[75215]:         </nova:port>
Nov 11 02:09:16 user nova-compute[75215]:       </nova:ports>
Nov 11 02:09:16 user nova-compute[75215]:     </nova:instance>
Nov 11 02:09:16 user nova-compute[75215]:   </metadata>
Nov 11 02:09:16 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:09:16 user nova-compute[75215]:     <system>
Nov 11 02:09:16 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:09:16 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:09:16 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:09:16 user nova-compute[75215]:       <entry name="serial">5728a539-e1b8-4ee4-b04e-7cbb956cc40d</entry>
Nov 11 02:09:16 user nova-compute[75215]:       <entry name="uuid">5728a539-e1b8-4ee4-b04e-7cbb956cc40d</entry>
Nov 11 02:09:16 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:09:16 user nova-compute[75215]:     </system>
Nov 11 02:09:16 user nova-compute[75215]:   </sysinfo>
Nov 11 02:09:16 user nova-compute[75215]:   <os>
Nov 11 02:09:16 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:09:16 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:09:16 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:09:16 user nova-compute[75215]:   </os>
Nov 11 02:09:16 user nova-compute[75215]:   <features>
Nov 11 02:09:16 user nova-compute[75215]:     <acpi/>
Nov 11 02:09:16 user nova-compute[75215]:     <apic/>
Nov 11 02:09:16 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:09:16 user nova-compute[75215]:   </features>
Nov 11 02:09:16 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:09:16 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:09:16 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:09:16 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:09:16 user nova-compute[75215]:   </clock>
Nov 11 02:09:16 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:09:16 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:09:16 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:09:16 user nova-compute[75215]:   </cpu>
Nov 11 02:09:16 user nova-compute[75215]:   <devices>
Nov 11 02:09:16 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 02:09:16 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:09:16 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 11 02:09:16 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:09:16 user nova-compute[75215]:       <serial>94520099-7b8e-42c7-849f-b42dd84785f1</serial>
Nov 11 02:09:16 user nova-compute[75215]:     </disk>
Nov 11 02:09:16 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:09:16 user nova-compute[75215]:       <mac address="fa:16:3e:9f:24:4a"/>
Nov 11 02:09:16 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:09:16 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:09:16 user nova-compute[75215]:       <target dev="tapc34bf040-77"/>
Nov 11 02:09:16 user nova-compute[75215]:     </interface>
Nov 11 02:09:16 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:09:16 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/5728a539-e1b8-4ee4-b04e-7cbb956cc40d/console.log" append="off"/>
Nov 11 02:09:16 user nova-compute[75215]:     </serial>
Nov 11 02:09:16 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:09:16 user nova-compute[75215]:     <video>
Nov 11 02:09:16 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:09:16 user nova-compute[75215]:     </video>
Nov 11 02:09:16 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:09:16 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:09:16 user nova-compute[75215]:     </rng>
Nov 11 02:09:16 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:09:16 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:09:16 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:09:16 user nova-compute[75215]:     </memballoon>
Nov 11 02:09:16 user nova-compute[75215]:   </devices>
Nov 11 02:09:16 user nova-compute[75215]: </domain>
Nov 11 02:09:16 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T02:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671404116',display_name='tempest-TestShelveInstance-server-1671404116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671404116',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-580171368',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:05:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5a7d240f44174c0b9a05c9ab2857a57a',ramdisk_id='',reservation_id='r-esh6lg1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-160686239',owner_user_name='tempest-TestShelveInstance-160686239-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:08:48Z,user_data=None,user_id='5d0f3651de0743eb8cb0b03f2ad9d83b',uuid=5728a539-e1b8-4ee4-b04e-7cbb956cc40d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converting VIF {"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG os_vif [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae43ffea-f823-502e-8da5-f9c0324a0871', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc34bf040-77, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc34bf040-77, col_values=(('qos', UUID('2b839c1a-f33e-4870-b78c-73d99b0aca1b')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc34bf040-77, col_values=(('external_ids', {'iface-id': 'c34bf040-7798-4da0-a95e-3c8569f9b815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:24:4a', 'vm-uuid': '5728a539-e1b8-4ee4-b04e-7cbb956cc40d'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:16 user nova-compute[75215]: INFO os_vif [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77')
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:09:16 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] No VIF found with MAC fa:16:3e:9f:24:4a, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-5fe91972-02ba-4213-bf6c-f4ca56a166ac req-76221ab8-c174-4aa3-b7cf-fc4935dc3eb9 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fe91972-02ba-4213-bf6c-f4ca56a166ac req-76221ab8-c174-4aa3-b7cf-fc4935dc3eb9 service nova] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fe91972-02ba-4213-bf6c-f4ca56a166ac req-76221ab8-c174-4aa3-b7cf-fc4935dc3eb9 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-5fe91972-02ba-4213-bf6c-f4ca56a166ac req-76221ab8-c174-4aa3-b7cf-fc4935dc3eb9 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG nova.compute.manager [req-5fe91972-02ba-4213-bf6c-f4ca56a166ac req-76221ab8-c174-4aa3-b7cf-fc4935dc3eb9 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] No waiting events found dispatching network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:09:18 user nova-compute[75215]: WARNING nova.compute.manager [req-5fe91972-02ba-4213-bf6c-f4ca56a166ac req-76221ab8-c174-4aa3-b7cf-fc4935dc3eb9 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received unexpected event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 02:09:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:18 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:09:20 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:09:20 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance spawned successfully.
Nov 11 02:09:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-2d2c6e24-6247-47bb-a13b-5874ae9a5be9 req-bf77469a-921c-427a-9959-de5e65fb5a86 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2d2c6e24-6247-47bb-a13b-5874ae9a5be9 req-bf77469a-921c-427a-9959-de5e65fb5a86 service nova] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2d2c6e24-6247-47bb-a13b-5874ae9a5be9 req-bf77469a-921c-427a-9959-de5e65fb5a86 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-2d2c6e24-6247-47bb-a13b-5874ae9a5be9 req-bf77469a-921c-427a-9959-de5e65fb5a86 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:20 user nova-compute[75215]: DEBUG nova.compute.manager [req-2d2c6e24-6247-47bb-a13b-5874ae9a5be9 req-bf77469a-921c-427a-9959-de5e65fb5a86 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] No waiting events found dispatching network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:09:20 user nova-compute[75215]: WARNING nova.compute.manager [req-2d2c6e24-6247-47bb-a13b-5874ae9a5be9 req-bf77469a-921c-427a-9959-de5e65fb5a86 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received unexpected event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 02:09:20 user nova-compute[75215]: DEBUG nova.compute.manager [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:09:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:20 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-73e7e8ca-610d-437d-90cd-38883046875e tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 32.509s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:09:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:09:35 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:09:35 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8642MB free_disk=25.154563903808594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:09:35 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance f7d78636-cf35-488c-978c-fc475a161a06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5728a539-e1b8-4ee4-b04e-7cbb956cc40d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:09:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:47 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:09:47 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:09:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:09:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:09:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:09:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:09:50 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:09:50 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:09:51 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updating instance_info_cache with network_info: [{"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:09:51 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:09:51 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:09:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:09:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:09:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:09:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:09:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:10:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-24ef0ea3-79d0-4f68-8e50-922860addbb2 req-104bbb98-5d2e-4864-acb9-77b95b94d071 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received event network-changed-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:10:09 user nova-compute[75215]: DEBUG nova.compute.manager [req-24ef0ea3-79d0-4f68-8e50-922860addbb2 req-104bbb98-5d2e-4864-acb9-77b95b94d071 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Refreshing instance network info cache due to event network-changed-697a9f11-8a6f-44b6-a3e9-cc7384244fd4. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:10:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-24ef0ea3-79d0-4f68-8e50-922860addbb2 req-104bbb98-5d2e-4864-acb9-77b95b94d071 service nova] Acquiring lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:10:09 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-24ef0ea3-79d0-4f68-8e50-922860addbb2 req-104bbb98-5d2e-4864-acb9-77b95b94d071 service nova] Acquired lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:10:09 user nova-compute[75215]: DEBUG nova.network.neutron [req-24ef0ea3-79d0-4f68-8e50-922860addbb2 req-104bbb98-5d2e-4864-acb9-77b95b94d071 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Refreshing network info cache for port 697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.network.neutron [req-24ef0ea3-79d0-4f68-8e50-922860addbb2 req-104bbb98-5d2e-4864-acb9-77b95b94d071 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updated VIF entry in instance network info cache for port 697a9f11-8a6f-44b6-a3e9-cc7384244fd4. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.network.neutron [req-24ef0ea3-79d0-4f68-8e50-922860addbb2 req-104bbb98-5d2e-4864-acb9-77b95b94d071 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updating instance_info_cache with network_info: [{"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-24ef0ea3-79d0-4f68-8e50-922860addbb2 req-104bbb98-5d2e-4864-acb9-77b95b94d071 service nova] Releasing lock "refresh_cache-f7d78636-cf35-488c-978c-fc475a161a06" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "f7d78636-cf35-488c-978c-fc475a161a06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "f7d78636-cf35-488c-978c-fc475a161a06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "f7d78636-cf35-488c-978c-fc475a161a06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:10 user nova-compute[75215]: INFO nova.compute.manager [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Terminating instance
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-b802e4c9-ad36-4cf2-81ec-61df953e7350 req-a4aac6d2-4068-4a0c-9482-b68254b98d33 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received event network-vif-unplugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b802e4c9-ad36-4cf2-81ec-61df953e7350 req-a4aac6d2-4068-4a0c-9482-b68254b98d33 service nova] Acquiring lock "f7d78636-cf35-488c-978c-fc475a161a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b802e4c9-ad36-4cf2-81ec-61df953e7350 req-a4aac6d2-4068-4a0c-9482-b68254b98d33 service nova] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-b802e4c9-ad36-4cf2-81ec-61df953e7350 req-a4aac6d2-4068-4a0c-9482-b68254b98d33 service nova] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-b802e4c9-ad36-4cf2-81ec-61df953e7350 req-a4aac6d2-4068-4a0c-9482-b68254b98d33 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] No waiting events found dispatching network-vif-unplugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.compute.manager [req-b802e4c9-ad36-4cf2-81ec-61df953e7350 req-a4aac6d2-4068-4a0c-9482-b68254b98d33 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received event network-vif-unplugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:10:10 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Instance destroyed successfully.
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'resources' on Instance uuid f7d78636-cf35-488c-978c-fc475a161a06 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-247836696',display_name='tempest-TestVolumeBootPattern-server-247836696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-247836696',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-5a3y91z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:08:48Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=f7d78636-cf35-488c-978c-fc475a161a06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "address": "fa:16:3e:73:11:3d", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697a9f11-8a", "ovs_interfaceid": "697a9f11-8a6f-44b6-a3e9-cc7384244fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:11:3d,bridge_name='br-int',has_traffic_filtering=True,id=697a9f11-8a6f-44b6-a3e9-cc7384244fd4,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697a9f11-8a') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG os_vif [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:11:3d,bridge_name='br-int',has_traffic_filtering=True,id=697a9f11-8a6f-44b6-a3e9-cc7384244fd4,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697a9f11-8a') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap697a9f11-8a, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46a2f983-ba1f-4982-84a2-2d9d60bf8640) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:10 user nova-compute[75215]: INFO os_vif [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:11:3d,bridge_name='br-int',has_traffic_filtering=True,id=697a9f11-8a6f-44b6-a3e9-cc7384244fd4,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697a9f11-8a')
Nov 11 02:10:10 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKuREMTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:10:10 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:10:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6896a885-f9cc-4c21-a110-349e7da09904]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:addd64cc-c736-4b3a-9448-4a34209892bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:10:10 user nova-compute[75215]: No targets found.
Nov 11 02:10:10 user nova-compute[75215]: iSNS:
Nov 11 02:10:10 user nova-compute[75215]: No targets found.
Nov 11 02:10:10 user nova-compute[75215]: STATIC:
Nov 11 02:10:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:addd64cc-c736-4b3a-9448-4a34209892bf
Nov 11 02:10:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:10:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:10:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1
Nov 11 02:10:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:10:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:10:10 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1
Nov 11 02:10:10 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:10:10 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:10:10 user nova-compute[75215]: FIRMWARE:
Nov 11 02:10:10 user nova-compute[75215]: No targets found.
Nov 11 02:10:10 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:10:10 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:10:10 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:10:10 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[981c6c70-6bca-4cb1-bd67-b1bd9c39289e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:addd64cc-c736-4b3a-9448-4a34209892bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a9b2a3-e6a0-426e-ba57-7888edacc5d8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:addd64cc-c736-4b3a-9448-4a34209892bf (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:10:11 user nova-compute[75215]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:10:11 user nova-compute[75215]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:addd64cc-c736-4b3a-9448-4a34209892bf (non-flash)
Nov 11 02:10:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:10:11 user nova-compute[75215]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:10:11 user nova-compute[75215]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:addd64cc-c736-4b3a-9448-4a34209892bf (non-flash)
Nov 11 02:10:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40643fc820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[69abaaeb-45bf-43bf-906f-1a03f592eabd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7683a0ad-9a46-41b9-8c68-f8f00943122f]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[900cc70d-cd92-4f2d-84ce-efe86cdb9aa7]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b038b-8abb-4908-a1bd-6a6829ef6629]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6654b-6e7b-48ec-a2a7-700b2d21179d]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d83bcca-c546-42d3-8106-dfd873337ba1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260]
Nov 11 02:10:11 user nova-compute[75215]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260] successful.
Nov 11 02:10:11 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6111afe-ece0-4274-ba5e-d556d06d9333]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== disconnect_volume: return (326ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:10:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Deleting instance files /opt/stack/data/nova/instances/f7d78636-cf35-488c-978c-fc475a161a06_del
Nov 11 02:10:11 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Deletion of /opt/stack/data/nova/instances/f7d78636-cf35-488c-978c-fc475a161a06_del complete
Nov 11 02:10:11 user nova-compute[75215]: INFO nova.compute.manager [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 11 02:10:11 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:10:11 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: f7d78636-cf35-488c-978c-fc475a161a06] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:10:12 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:10:12 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Took 0.79 seconds to deallocate network for instance.
Nov 11 02:10:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-a9dd9801-4539-4465-9dfd-3cd252bd0dc3 req-94d07cdf-1c03-4e6a-9ea2-5e3c7d1faa66 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received event network-vif-deleted-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:10:12 user nova-compute[75215]: INFO nova.compute.manager [req-a9dd9801-4539-4465-9dfd-3cd252bd0dc3 req-94d07cdf-1c03-4e6a-9ea2-5e3c7d1faa66 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Neutron deleted interface 697a9f11-8a6f-44b6-a3e9-cc7384244fd4; detaching it from the instance and deleting it from the info cache
Nov 11 02:10:12 user nova-compute[75215]: DEBUG nova.network.neutron [req-a9dd9801-4539-4465-9dfd-3cd252bd0dc3 req-94d07cdf-1c03-4e6a-9ea2-5e3c7d1faa66 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:10:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-a9dd9801-4539-4465-9dfd-3cd252bd0dc3 req-94d07cdf-1c03-4e6a-9ea2-5e3c7d1faa66 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Detach interface failed, port_id=697a9f11-8a6f-44b6-a3e9-cc7384244fd4, reason: Instance f7d78636-cf35-488c-978c-fc475a161a06 could not be found. {{(pid=75215) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 02:10:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-94756ab9-587d-4ef4-8f7b-02822d7070c6 req-d1519150-d54b-47fa-b94c-813fb3b68265 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received event network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:10:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94756ab9-587d-4ef4-8f7b-02822d7070c6 req-d1519150-d54b-47fa-b94c-813fb3b68265 service nova] Acquiring lock "f7d78636-cf35-488c-978c-fc475a161a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94756ab9-587d-4ef4-8f7b-02822d7070c6 req-d1519150-d54b-47fa-b94c-813fb3b68265 service nova] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:12 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94756ab9-587d-4ef4-8f7b-02822d7070c6 req-d1519150-d54b-47fa-b94c-813fb3b68265 service nova] Lock "f7d78636-cf35-488c-978c-fc475a161a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:12 user nova-compute[75215]: DEBUG nova.compute.manager [req-94756ab9-587d-4ef4-8f7b-02822d7070c6 req-d1519150-d54b-47fa-b94c-813fb3b68265 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] No waiting events found dispatching network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:10:12 user nova-compute[75215]: WARNING nova.compute.manager [req-94756ab9-587d-4ef4-8f7b-02822d7070c6 req-d1519150-d54b-47fa-b94c-813fb3b68265 service nova] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Received unexpected event network-vif-plugged-697a9f11-8a6f-44b6-a3e9-cc7384244fd4 for instance with vm_state active and task_state deleting.
Nov 11 02:10:13 user nova-compute[75215]: INFO nova.compute.manager [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: f7d78636-cf35-488c-978c-fc475a161a06] Took 0.95 seconds to detach 1 volumes for instance.
Nov 11 02:10:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:13 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:10:13 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:10:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:13 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Deleted allocations for instance f7d78636-cf35-488c-978c-fc475a161a06
Nov 11 02:10:13 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f18ccf40-4dd4-46bf-99b9-abf9f22bd79b tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "f7d78636-cf35-488c-978c-fc475a161a06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.377s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:10:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:10:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:10:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:10:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:10:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:10:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:10:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:10:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:10:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:10:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:10:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:10:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:10:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=25.152496337890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 5728a539-e1b8-4ee4-b04e-7cbb956cc40d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:10:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:10:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:10:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:10:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:10:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-8be6855a-caee-44e3-91aa-77f0aebe7356 req-88032836-5a53-4a51-aaf9-1a721fcf5332 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG nova.compute.manager [req-8be6855a-caee-44e3-91aa-77f0aebe7356 req-88032836-5a53-4a51-aaf9-1a721fcf5332 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing instance network info cache due to event network-changed-c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8be6855a-caee-44e3-91aa-77f0aebe7356 req-88032836-5a53-4a51-aaf9-1a721fcf5332 service nova] Acquiring lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8be6855a-caee-44e3-91aa-77f0aebe7356 req-88032836-5a53-4a51-aaf9-1a721fcf5332 service nova] Acquired lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG nova.network.neutron [req-8be6855a-caee-44e3-91aa-77f0aebe7356 req-88032836-5a53-4a51-aaf9-1a721fcf5332 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Refreshing network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:38 user nova-compute[75215]: INFO nova.compute.manager [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Terminating instance
Nov 11 02:10:38 user nova-compute[75215]: DEBUG nova.compute.manager [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:38 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a6a9c1b-37ba-44d7-bab3-39caea075462 req-7690b6d4-8b19-4a28-9204-eb05dbbfbc0a service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-unplugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a6a9c1b-37ba-44d7-bab3-39caea075462 req-7690b6d4-8b19-4a28-9204-eb05dbbfbc0a service nova] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a6a9c1b-37ba-44d7-bab3-39caea075462 req-7690b6d4-8b19-4a28-9204-eb05dbbfbc0a service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8a6a9c1b-37ba-44d7-bab3-39caea075462 req-7690b6d4-8b19-4a28-9204-eb05dbbfbc0a service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a6a9c1b-37ba-44d7-bab3-39caea075462 req-7690b6d4-8b19-4a28-9204-eb05dbbfbc0a service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] No waiting events found dispatching network-vif-unplugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.compute.manager [req-8a6a9c1b-37ba-44d7-bab3-39caea075462 req-7690b6d4-8b19-4a28-9204-eb05dbbfbc0a service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-unplugged-c34bf040-7798-4da0-a95e-3c8569f9b815 for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-8be6855a-caee-44e3-91aa-77f0aebe7356 req-88032836-5a53-4a51-aaf9-1a721fcf5332 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updated VIF entry in instance network info cache for port c34bf040-7798-4da0-a95e-3c8569f9b815. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.network.neutron [req-8be6855a-caee-44e3-91aa-77f0aebe7356 req-88032836-5a53-4a51-aaf9-1a721fcf5332 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [{"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8be6855a-caee-44e3-91aa-77f0aebe7356 req-88032836-5a53-4a51-aaf9-1a721fcf5332 service nova] Releasing lock "refresh_cache-5728a539-e1b8-4ee4-b04e-7cbb956cc40d" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Instance destroyed successfully.
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.objects.instance [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lazy-loading 'resources' on Instance uuid 5728a539-e1b8-4ee4-b04e-7cbb956cc40d {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T02:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671404116',display_name='tempest-TestShelveInstance-server-1671404116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671404116',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFfvDPEwJ58zp0oTZPTcZf7TB1Yy6UkEm88Wv/5C2f/phGmTfOfLikqUU065E0kV13kN7pjaZfgxeKJDmn4Kw2VaABAUzwEDEFEEmiMK9UlXKb7pO89B1nOl8lnyEOM5A==',key_name='tempest-TestShelveInstance-580171368',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:09:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7d240f44174c0b9a05c9ab2857a57a',ramdisk_id='',reservation_id='r-esh6lg1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-160686239',owner_user_name='tempest-TestShelveInstance-160686239-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:09:20Z,user_data=None,user_id='5d0f3651de0743eb8cb0b03f2ad9d83b',uuid=5728a539-e1b8-4ee4-b04e-7cbb956cc40d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converting VIF {"id": "c34bf040-7798-4da0-a95e-3c8569f9b815", "address": "fa:16:3e:9f:24:4a", "network": {"id": "dc4ce88e-87d5-44bb-b35c-e4d20f5299cc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1234666748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d240f44174c0b9a05c9ab2857a57a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34bf040-77", "ovs_interfaceid": "c34bf040-7798-4da0-a95e-3c8569f9b815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_vif [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc34bf040-77, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b839c1a-f33e-4870-b78c-73d99b0aca1b) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:10:39 user nova-compute[75215]: INFO os_vif [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:24:4a,bridge_name='br-int',has_traffic_filtering=True,id=c34bf040-7798-4da0-a95e-3c8569f9b815,network=Network(dc4ce88e-87d5-44bb-b35c-e4d20f5299cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34bf040-77')
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFdAjbOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:10:39 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[db07000e-c966-418e-b8d9-55f4fc9a0e57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:10:39 user nova-compute[75215]: No targets found.
Nov 11 02:10:39 user nova-compute[75215]: iSNS:
Nov 11 02:10:39 user nova-compute[75215]: No targets found.
Nov 11 02:10:39 user nova-compute[75215]: STATIC:
Nov 11 02:10:39 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1
Nov 11 02:10:39 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:10:39 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:10:39 user nova-compute[75215]: FIRMWARE:
Nov 11 02:10:39 user nova-compute[75215]: No targets found.
Nov 11 02:10:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:10:39 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:10:39 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc815da-18c4-44b7-9508-c71cedaf0941]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e18dc1-cc02-48b0-aeb6-1fa874176a51]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:10:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 (non-flash)
Nov 11 02:10:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40643fc820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7747a299-86b1-47af-96c8-7aee8642cd1b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b972b8a2-4716-4afb-9105-c82cbc465d81]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe5512-5a7e-49e8-a814-28c58e6b4d4b]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2541b12e-94a5-43b1-93d8-aadd1fde704a]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7fe82a05-c44f7b2c46b9ad94', '/dev/disk/by-id/scsi-26334346637623263', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7fe82a05') {{(pid=86647) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[911cd593-3c52-4199-85a2-96e1cb3176de]: (4, None) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f19f28-195a-4221-bc88-6a48d27efb1f]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a415c4f-2e48-4216-9845-a33bdac0b336]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260]
Nov 11 02:10:39 user nova-compute[75215]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1, portal: 172.16.0.220,3260] successful.
Nov 11 02:10:39 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94520099-7b8e-42c7-849f-b42dd84785f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dcf66e-5731-49af-96ba-5378ce02513e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] <== disconnect_volume: return (312ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:10:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Deleting instance files /opt/stack/data/nova/instances/5728a539-e1b8-4ee4-b04e-7cbb956cc40d_del
Nov 11 02:10:39 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Deletion of /opt/stack/data/nova/instances/5728a539-e1b8-4ee4-b04e-7cbb956cc40d_del complete
Nov 11 02:10:39 user nova-compute[75215]: INFO nova.compute.manager [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 11 02:10:39 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:10:39 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:10:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:40 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:10:40 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Took 0.58 seconds to deallocate network for instance.
Nov 11 02:10:40 user nova-compute[75215]: DEBUG nova.compute.manager [req-943bc43e-0419-44b2-a061-abb26be52ffb req-71b164b0-23f8-443c-89a3-170dc5d48f60 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-deleted-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-7f5e1331-2a09-4ab7-811c-144460087b0e req-d85ed8dd-00f4-496a-b34d-9523781f27b5 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7f5e1331-2a09-4ab7-811c-144460087b0e req-d85ed8dd-00f4-496a-b34d-9523781f27b5 service nova] Acquiring lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7f5e1331-2a09-4ab7-811c-144460087b0e req-d85ed8dd-00f4-496a-b34d-9523781f27b5 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-7f5e1331-2a09-4ab7-811c-144460087b0e req-d85ed8dd-00f4-496a-b34d-9523781f27b5 service nova] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG nova.compute.manager [req-7f5e1331-2a09-4ab7-811c-144460087b0e req-d85ed8dd-00f4-496a-b34d-9523781f27b5 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] No waiting events found dispatching network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:10:41 user nova-compute[75215]: WARNING nova.compute.manager [req-7f5e1331-2a09-4ab7-811c-144460087b0e req-d85ed8dd-00f4-496a-b34d-9523781f27b5 service nova] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Received unexpected event network-vif-plugged-c34bf040-7798-4da0-a95e-3c8569f9b815 for instance with vm_state active and task_state deleting.
Nov 11 02:10:41 user nova-compute[75215]: INFO nova.compute.manager [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Took 1.03 seconds to detach 1 volumes for instance.
Nov 11 02:10:41 user nova-compute[75215]: DEBUG nova.compute.manager [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] [instance: 5728a539-e1b8-4ee4-b04e-7cbb956cc40d] Deleting volume: 94520099-7b8e-42c7-849f-b42dd84785f1 {{(pid=75215) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:10:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:41 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Deleted allocations for instance 5728a539-e1b8-4ee4-b04e-7cbb956cc40d
Nov 11 02:10:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-26e006ed-dbbd-4796-894c-fb7964588884 tempest-TestShelveInstance-160686239 tempest-TestShelveInstance-160686239-project-member] Lock "5728a539-e1b8-4ee4-b04e-7cbb956cc40d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.200s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:10:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:10:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:10:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:10:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:10:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 02:10:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:51 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 02:10:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 02:10:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:10:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:10:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:11:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "bfec93df-fc0b-4f42-b988-4dadff960763" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "bfec93df-fc0b-4f42-b988-4dadff960763" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:11:02 user nova-compute[75215]: INFO nova.compute.claims [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Claim successful on node user
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 02:11:02 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.policy [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '195d763c024c4db99be056d17d243171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5a366788b744f9b121b9e946ff230f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 02:11:02 user nova-compute[75215]: INFO nova.virt.block_device [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Booting with volume bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 at /dev/vda
Nov 11 02:11:02 user nova-compute[75215]: DEBUG os_brick.utils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdadbe2-06c0-4adb-aff9-1ad0640a9a33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ed7a0f-992e-4528-b927-c863b99e930a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58de3ee-8d23-4f26-a625-39401c53b2b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf648482-d96b-46e4-b701-9bcae4164619]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:11:02 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:11:02 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5effb468-4eee-478c-bd2b-341789325f8f]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG os_brick.utils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:11:02 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating existing volume attachment record: 3b4285f3-99b2-4f81-8805-19adf54dfb9f {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:11:03 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Successfully created port: c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Successfully updated port: c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquired lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-e7ffd5db-1fec-41e5-b116-e0cfab3b4846 req-64111ccf-cb6f-41db-9068-5442440f4165 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-changed-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.compute.manager [req-e7ffd5db-1fec-41e5-b116-e0cfab3b4846 req-64111ccf-cb6f-41db-9068-5442440f4165 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Refreshing instance network info cache due to event network-changed-c466850d-d032-4a7f-b54f-37d880466e5b. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e7ffd5db-1fec-41e5-b116-e0cfab3b4846 req-64111ccf-cb6f-41db-9068-5442440f4165 service nova] Acquiring lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.network.neutron [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Releasing lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Instance network_info: |[{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e7ffd5db-1fec-41e5-b116-e0cfab3b4846 req-64111ccf-cb6f-41db-9068-5442440f4165 service nova] Acquired lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-e7ffd5db-1fec-41e5-b116-e0cfab3b4846 req-64111ccf-cb6f-41db-9068-5442440f4165 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Refreshing network info cache for port c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-e7ffd5db-1fec-41e5-b116-e0cfab3b4846 req-64111ccf-cb6f-41db-9068-5442440f4165 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updated VIF entry in instance network info cache for port c466850d-d032-4a7f-b54f-37d880466e5b. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG nova.network.neutron [req-e7ffd5db-1fec-41e5-b116-e0cfab3b4846 req-64111ccf-cb6f-41db-9068-5442440f4165 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:11:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-e7ffd5db-1fec-41e5-b116-e0cfab3b4846 req-64111ccf-cb6f-41db-9068-5442440f4165 service nova] Releasing lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:11:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:11:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:11:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:11:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:11:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:11:14 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:14 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 02:11:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:11:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:36 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:11:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:11:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:11:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:11:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:11:36 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:11:36 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.141162872314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:11:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:11:36 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance bfec93df-fc0b-4f42-b988-4dadff960763 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:11:37 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:11:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:11:49 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Creating image(s)
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Ensure instance console log exists: /opt/stack/data/nova/instances/bfec93df-fc0b-4f42-b988-4dadff960763/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Start _get_guest_xml network_info=[{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '3b4285f3-99b2-4f81-8805-19adf54dfb9f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKuREMTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bfec93df-fc0b-4f42-b988-4dadff960763', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'serial': 'bf9e5fb2-187e-4933-a4fa-b28822c8f6a1'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:11:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:11:49 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKuREMTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:11:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:11:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:11:49 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:11:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:11:49 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:11:49 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:11:49 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2f9f87-774d-4290-a1cf-cf8c76d4ce4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:11:50 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f26c196-8eee-4f18-8312-cc71b2e186a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1] added
Nov 11 02:11:50 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1264bb07-d6e5-4673-ba3e-e911416ab7fc]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6488d0c0-d607-4e1e-9e3d-a9fa481f1492]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKuREMTp {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKuREMTp" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b67a75-87ec-46ec-b037-aec5d2bcbb4a]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OKuREMTp'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed11971-5d5f-499d-b816-c869a3ef40d4]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daf4359-bc61-4aed-95c9-6f116bead4ff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 02:11:50 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 02:11:50 user nova-compute[75215]:  {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:11:50 user nova-compute[75215]: WARNING os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 02:11:50 user nova-compute[75215]: 
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabbaa07-8199-478b-9274-478382bae240]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260]
Nov 11 02:11:50 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260] successful.
Nov 11 02:11:50 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b336317-eb41-428d-811d-8e542ab970eb]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a745c6d-bb72-43a4-bb01-6b50ef313acf]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:11:50 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:11:50 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b612875c-8631-4673-88d0-8068a321d9a8]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Skipping network cache update for instance because it is Building. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 02:11:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKuREMTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26332613838613364', 'path': '/dev/sdb'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332613838613364', 'path': '/dev/sdb'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-168472537',display_name='tempest-TestVolumeBootPattern-server-168472537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-168472537',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-0es4mdey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:11:03Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=bfec93df-fc0b-4f42-b988-4dadff960763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a9:8e,bridge_name='br-int',has_traffic_filtering=True,id=c466850d-d032-4a7f-b54f-37d880466e5b,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc466850d-d0') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.objects.instance [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'pci_devices' on Instance uuid bfec93df-fc0b-4f42-b988-4dadff960763 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:11:51 user nova-compute[75215]:   <uuid>bfec93df-fc0b-4f42-b988-4dadff960763</uuid>
Nov 11 02:11:51 user nova-compute[75215]:   <name>instance-00000033</name>
Nov 11 02:11:51 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:11:51 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:11:51 user nova-compute[75215]:   <metadata>
Nov 11 02:11:51 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:11:51 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:11:51 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-server-168472537</nova:name>
Nov 11 02:11:51 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:11:49</nova:creationTime>
Nov 11 02:11:51 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:11:51 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:11:51 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:11:51 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:11:51 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:11:51 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:11:51 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:11:51 user nova-compute[75215]:       <nova:owner>
Nov 11 02:11:51 user nova-compute[75215]:         <nova:user uuid="195d763c024c4db99be056d17d243171">tempest-TestVolumeBootPattern-1487726842-project-member</nova:user>
Nov 11 02:11:51 user nova-compute[75215]:         <nova:project uuid="ca5a366788b744f9b121b9e946ff230f">tempest-TestVolumeBootPattern-1487726842</nova:project>
Nov 11 02:11:51 user nova-compute[75215]:       </nova:owner>
Nov 11 02:11:51 user nova-compute[75215]:       <nova:ports>
Nov 11 02:11:51 user nova-compute[75215]:         <nova:port uuid="c466850d-d032-4a7f-b54f-37d880466e5b">
Nov 11 02:11:51 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 02:11:51 user nova-compute[75215]:         </nova:port>
Nov 11 02:11:51 user nova-compute[75215]:       </nova:ports>
Nov 11 02:11:51 user nova-compute[75215]:     </nova:instance>
Nov 11 02:11:51 user nova-compute[75215]:   </metadata>
Nov 11 02:11:51 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:11:51 user nova-compute[75215]:     <system>
Nov 11 02:11:51 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:11:51 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:11:51 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:11:51 user nova-compute[75215]:       <entry name="serial">bfec93df-fc0b-4f42-b988-4dadff960763</entry>
Nov 11 02:11:51 user nova-compute[75215]:       <entry name="uuid">bfec93df-fc0b-4f42-b988-4dadff960763</entry>
Nov 11 02:11:51 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:11:51 user nova-compute[75215]:     </system>
Nov 11 02:11:51 user nova-compute[75215]:   </sysinfo>
Nov 11 02:11:51 user nova-compute[75215]:   <os>
Nov 11 02:11:51 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:11:51 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:11:51 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:11:51 user nova-compute[75215]:   </os>
Nov 11 02:11:51 user nova-compute[75215]:   <features>
Nov 11 02:11:51 user nova-compute[75215]:     <acpi/>
Nov 11 02:11:51 user nova-compute[75215]:     <apic/>
Nov 11 02:11:51 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:11:51 user nova-compute[75215]:   </features>
Nov 11 02:11:51 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:11:51 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:11:51 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:11:51 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:11:51 user nova-compute[75215]:   </clock>
Nov 11 02:11:51 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:11:51 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:11:51 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:11:51 user nova-compute[75215]:   </cpu>
Nov 11 02:11:51 user nova-compute[75215]:   <devices>
Nov 11 02:11:51 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 02:11:51 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:11:51 user nova-compute[75215]:       <source dev="/dev/sdb"/>
Nov 11 02:11:51 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:11:51 user nova-compute[75215]:       <serial>bf9e5fb2-187e-4933-a4fa-b28822c8f6a1</serial>
Nov 11 02:11:51 user nova-compute[75215]:     </disk>
Nov 11 02:11:51 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:11:51 user nova-compute[75215]:       <mac address="fa:16:3e:df:a9:8e"/>
Nov 11 02:11:51 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:11:51 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:11:51 user nova-compute[75215]:       <target dev="tapc466850d-d0"/>
Nov 11 02:11:51 user nova-compute[75215]:     </interface>
Nov 11 02:11:51 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:11:51 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/bfec93df-fc0b-4f42-b988-4dadff960763/console.log" append="off"/>
Nov 11 02:11:51 user nova-compute[75215]:     </serial>
Nov 11 02:11:51 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:11:51 user nova-compute[75215]:     <video>
Nov 11 02:11:51 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:11:51 user nova-compute[75215]:     </video>
Nov 11 02:11:51 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:11:51 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:11:51 user nova-compute[75215]:     </rng>
Nov 11 02:11:51 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:11:51 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:11:51 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:11:51 user nova-compute[75215]:     </memballoon>
Nov 11 02:11:51 user nova-compute[75215]:   </devices>
Nov 11 02:11:51 user nova-compute[75215]: </domain>
Nov 11 02:11:51 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-168472537',display_name='tempest-TestVolumeBootPattern-server-168472537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-168472537',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-0es4mdey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:11:03Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=bfec93df-fc0b-4f42-b988-4dadff960763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a9:8e,bridge_name='br-int',has_traffic_filtering=True,id=c466850d-d032-4a7f-b54f-37d880466e5b,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc466850d-d0') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG os_vif [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a9:8e,bridge_name='br-int',has_traffic_filtering=True,id=c466850d-d032-4a7f-b54f-37d880466e5b,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc466850d-d0') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c59e4a7e-9ba1-58c3-b9f8-46313a80af90', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc466850d-d0, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc466850d-d0, col_values=(('qos', UUID('e7042c50-fe58-46f0-a38e-0c25f081c8dc')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc466850d-d0, col_values=(('external_ids', {'iface-id': 'c466850d-d032-4a7f-b54f-37d880466e5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:a9:8e', 'vm-uuid': 'bfec93df-fc0b-4f42-b988-4dadff960763'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:51 user nova-compute[75215]: INFO os_vif [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a9:8e,bridge_name='br-int',has_traffic_filtering=True,id=c466850d-d032-4a7f-b54f-37d880466e5b,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc466850d-d0')
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:11:51 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No VIF found with MAC fa:16:3e:df:a9:8e, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-689ab9de-9067-46fb-818e-6a9d0999b4e7 req-9edd073a-6da7-4528-8b66-5138794ec6b1 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-689ab9de-9067-46fb-818e-6a9d0999b4e7 req-9edd073a-6da7-4528-8b66-5138794ec6b1 service nova] Acquiring lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-689ab9de-9067-46fb-818e-6a9d0999b4e7 req-9edd073a-6da7-4528-8b66-5138794ec6b1 service nova] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-689ab9de-9067-46fb-818e-6a9d0999b4e7 req-9edd073a-6da7-4528-8b66-5138794ec6b1 service nova] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:11:52 user nova-compute[75215]: DEBUG nova.compute.manager [req-689ab9de-9067-46fb-818e-6a9d0999b4e7 req-9edd073a-6da7-4528-8b66-5138794ec6b1 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] No waiting events found dispatching network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:11:52 user nova-compute[75215]: WARNING nova.compute.manager [req-689ab9de-9067-46fb-818e-6a9d0999b4e7 req-9edd073a-6da7-4528-8b66-5138794ec6b1 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received unexpected event network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b for instance with vm_state building and task_state spawning.
Nov 11 02:11:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:53 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:11:54 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Instance spawned successfully.
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:11:54 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:11:55 user nova-compute[75215]: INFO nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 11 02:11:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:11:55 user nova-compute[75215]: INFO nova.compute.manager [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Took 52.84 seconds to build instance.
Nov 11 02:11:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-f1d9298f-e463-4445-852e-5c91ce3205f6 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "bfec93df-fc0b-4f42-b988-4dadff960763" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.944s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:11:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-c592bf4d-5f82-410b-b61b-9112b019e47b req-42027eb4-be6c-4aac-be31-12e37ace00f3 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:11:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c592bf4d-5f82-410b-b61b-9112b019e47b req-42027eb4-be6c-4aac-be31-12e37ace00f3 service nova] Acquiring lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:11:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c592bf4d-5f82-410b-b61b-9112b019e47b req-42027eb4-be6c-4aac-be31-12e37ace00f3 service nova] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:11:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-c592bf4d-5f82-410b-b61b-9112b019e47b req-42027eb4-be6c-4aac-be31-12e37ace00f3 service nova] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:11:55 user nova-compute[75215]: DEBUG nova.compute.manager [req-c592bf4d-5f82-410b-b61b-9112b019e47b req-42027eb4-be6c-4aac-be31-12e37ace00f3 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] No waiting events found dispatching network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:11:55 user nova-compute[75215]: WARNING nova.compute.manager [req-c592bf4d-5f82-410b-b61b-9112b019e47b req-42027eb4-be6c-4aac-be31-12e37ace00f3 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received unexpected event network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b for instance with vm_state active and task_state None.
Nov 11 02:11:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:11:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:11:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:03 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:12:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:12:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:12:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:12:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:38 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:12:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:12:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:12:38 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:12:38 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:12:38 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:12:38 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:12:38 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=25.13872528076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:12:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:12:38 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:12:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance bfec93df-fc0b-4f42-b988-4dadff960763 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:12:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:12:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:12:39 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:12:39 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:12:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:12:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:12:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:12:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:12:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:12:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:12:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:12:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:12:48 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:48 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:12:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:12:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:12:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:12:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:12:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid bfec93df-fc0b-4f42-b988-4dadff960763 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:12:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:12:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:12:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:13:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:13:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:13:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:13:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:13:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:13:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:13:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:13:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:13:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:13:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:13:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:13:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:13:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:13:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:13:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:36 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:13:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:13:39 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:13:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=25.137672424316406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance bfec93df-fc0b-4f42-b988-4dadff960763 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:13:39 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:13:40 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:13:40 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:13:40 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:13:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:13:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:13:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:13:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:13:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:13:41 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb1c048b-1759-4ec9-ba93-c7042c99d9e3 req-73cee5b5-fcbb-466c-b82a-1c5d87409787 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-changed-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:13:44 user nova-compute[75215]: DEBUG nova.compute.manager [req-bb1c048b-1759-4ec9-ba93-c7042c99d9e3 req-73cee5b5-fcbb-466c-b82a-1c5d87409787 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Refreshing instance network info cache due to event network-changed-c466850d-d032-4a7f-b54f-37d880466e5b. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:13:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb1c048b-1759-4ec9-ba93-c7042c99d9e3 req-73cee5b5-fcbb-466c-b82a-1c5d87409787 service nova] Acquiring lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:13:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb1c048b-1759-4ec9-ba93-c7042c99d9e3 req-73cee5b5-fcbb-466c-b82a-1c5d87409787 service nova] Acquired lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:13:44 user nova-compute[75215]: DEBUG nova.network.neutron [req-bb1c048b-1759-4ec9-ba93-c7042c99d9e3 req-73cee5b5-fcbb-466c-b82a-1c5d87409787 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Refreshing network info cache for port c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:13:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-bb1c048b-1759-4ec9-ba93-c7042c99d9e3 req-73cee5b5-fcbb-466c-b82a-1c5d87409787 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updated VIF entry in instance network info cache for port c466850d-d032-4a7f-b54f-37d880466e5b. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:13:45 user nova-compute[75215]: DEBUG nova.network.neutron [req-bb1c048b-1759-4ec9-ba93-c7042c99d9e3 req-73cee5b5-fcbb-466c-b82a-1c5d87409787 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:13:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-bb1c048b-1759-4ec9-ba93-c7042c99d9e3 req-73cee5b5-fcbb-466c-b82a-1c5d87409787 service nova] Releasing lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:13:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:46 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:49 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:49 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:13:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:51 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:13:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:13:52 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:13:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:13:52 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid bfec93df-fc0b-4f42-b988-4dadff960763 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:13:52 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:13:53 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:13:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:13:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:56 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:13:57 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:13:58 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:01 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "78d6d883-986b-40a9-8b55-b5d0b5d26242" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Starting instance... {{(pid=75215) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75215) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 02:14:04 user nova-compute[75215]: INFO nova.compute.claims [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Claim successful on node user
Nov 11 02:14:04 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:14:04 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Start building networks asynchronously for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Allocating IP information in the background. {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] allocate_for_instance() {{(pid=75215) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 02:14:05 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 02:14:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Start building block device mappings for instance. {{(pid=75215) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG nova.policy [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '195d763c024c4db99be056d17d243171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5a366788b744f9b121b9e946ff230f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75215) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 02:14:05 user nova-compute[75215]: INFO nova.virt.block_device [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Booting with volume ff2ceac9-b880-41da-a956-548f9d958b99 at /dev/vda
Nov 11 02:14:05 user nova-compute[75215]: DEBUG os_brick.utils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[53384865-047f-49c1-a623-bb8550360dfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c31af0139cd\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[341e9a0c-9248-4a14-9f9c-de52ef12f024]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[126ee901-b55e-4e9c-9f58-3321e948eafe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6c9ea6-73ca-4f45-af8a-b1a152af5eef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Running cmd (subprocess): nvme version {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75215) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] nvme not present on system {{(pid=75215) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 02:14:05 user nova-compute[75215]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2f2d25-02cf-4e97-8f88-5607f5a2e287]: (4, '') {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75215) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] LIGHTOS: no hostnqn found. {{(pid=75215) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG os_brick.utils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c31af0139cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG nova.virt.block_device [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updating existing volume attachment record: dab0cb4b-922d-43ad-8bb5-6d014b4499d0 {{(pid=75215) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:05 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Successfully created port: 8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Successfully updated port: 8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquired lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Building network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-8deb2f87-f974-47a0-aa24-9a56d43e3e5f req-f8b26e0d-51e2-43cc-8c18-80f5d73b0d2d service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-changed-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG nova.compute.manager [req-8deb2f87-f974-47a0-aa24-9a56d43e3e5f req-f8b26e0d-51e2-43cc-8c18-80f5d73b0d2d service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Refreshing instance network info cache due to event network-changed-8ee3ec7e-1794-4384-acd3-d324b615f3fd. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8deb2f87-f974-47a0-aa24-9a56d43e3e5f req-f8b26e0d-51e2-43cc-8c18-80f5d73b0d2d service nova] Acquiring lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:14:06 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Instance cache missing network info. {{(pid=75215) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG nova.network.neutron [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updating instance_info_cache with network_info: [{"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Releasing lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Instance network_info: |[{"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75215) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8deb2f87-f974-47a0-aa24-9a56d43e3e5f req-f8b26e0d-51e2-43cc-8c18-80f5d73b0d2d service nova] Acquired lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-8deb2f87-f974-47a0-aa24-9a56d43e3e5f req-f8b26e0d-51e2-43cc-8c18-80f5d73b0d2d service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Refreshing network info cache for port 8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-8deb2f87-f974-47a0-aa24-9a56d43e3e5f req-f8b26e0d-51e2-43cc-8c18-80f5d73b0d2d service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updated VIF entry in instance network info cache for port 8ee3ec7e-1794-4384-acd3-d324b615f3fd. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG nova.network.neutron [req-8deb2f87-f974-47a0-aa24-9a56d43e3e5f req-f8b26e0d-51e2-43cc-8c18-80f5d73b0d2d service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updating instance_info_cache with network_info: [{"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:14:07 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-8deb2f87-f974-47a0-aa24-9a56d43e3e5f req-f8b26e0d-51e2-43cc-8c18-80f5d73b0d2d service nova] Releasing lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:14:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:14:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:14:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:14:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:14:11 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:16 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:14:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:14:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:14:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:14:21 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:14:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:14:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:14:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:14:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Start spawning the instance on the hypervisor. {{(pid=75215) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Creating instance directory {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 02:14:29 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Creating image(s)
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Did not create local disks {{(pid=75215) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Ensure instance console log exists: /opt/stack/data/nova/instances/78d6d883-986b-40a9-8b55-b5d0b5d26242/console.log {{(pid=75215) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Start _get_guest_xml network_info=[{"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'dab0cb4b-922d-43ad-8bb5-6d014b4499d0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwMyOqAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78d6d883-986b-40a9-8b55-b5d0b5d26242', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff2ceac9-b880-41da-a956-548f9d958b99', 'serial': 'ff2ceac9-b880-41da-a956-548f9d958b99'}, 'volume_type': None} {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 02:14:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:14:29 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller missing on host. {{(pid=75215) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.host [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU controller found on host. {{(pid=75215) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75215) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-11T01:25:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image limits 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flavor pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Image pref 0:0:0 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Got 1 possible topologies {{(pid=75215) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.hardware [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75215) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Calling os-brick to attach iSCSI Volume {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwMyOqAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:14:29 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:14:29 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:14:29 user nova-compute[75215]: INFO os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce4ec8c-7237-457e-9264-a8b61f5f8cdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 02:14:29 user nova-compute[75215]:  {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --interface default --op new {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e95fbb-ddb3-415f-b7a4-74606b6a5ae3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99] added\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99] added
Nov 11 02:14:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bbf7a0-fdb1-4440-968d-9c22e2fa55d1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[5302a27d-1e8b-49b3-bb44-a9d6a9b64284]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bwMyOqAJ {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bwMyOqAJ" returned: 0 in 0.023s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f6c7c7-5041-47bb-83e0-883e668551d5]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bwMyOqAJ'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca0a876-2d38-46b5-ba81-95be35cc4d66]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[631855a1-31bf-4919-a856-692b8f46e430]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:14:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:14:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --login {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc626a5-aec0-4330-851f-b3e50bdb5f57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99, portal: 172.16.0.220,3260]
Nov 11 02:14:29 user nova-compute[75215]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99, portal: 172.16.0.220,3260] successful.
Nov 11 02:14:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[393d41da-0268-4df5-a616-21699c8c68c8]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ef1ac9-b509-4c71-97f2-a964fade9a5e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:14:29 user nova-compute[75215]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 (non-flash)
Nov 11 02:14:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:14:29 user nova-compute[75215]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 (non-flash)
Nov 11 02:14:29 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to 172.16.0.220:3260 {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75215) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75215) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c80b14-f654-4387-9ba2-b93f7841835f]: (4, ('- - 0', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75215) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 02:14:29 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwMyOqAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75215) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26137353732323463', 'path': '/dev/sdc'} {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137353732323463', 'path': '/dev/sdc'} {{(pid=75215) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1090435726',display_name='tempest-TestVolumeBootPattern-server-1090435726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1090435726',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-j7fujn17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:14:05Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=78d6d883-986b-40a9-8b55-b5d0b5d26242,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75215) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:6b:87,bridge_name='br-int',has_traffic_filtering=True,id=8ee3ec7e-1794-4384-acd3-d324b615f3fd,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee3ec7e-17') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.objects.instance [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'pci_devices' on Instance uuid 78d6d883-986b-40a9-8b55-b5d0b5d26242 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] End _get_guest_xml xml=<domain type="kvm">
Nov 11 02:14:30 user nova-compute[75215]:   <uuid>78d6d883-986b-40a9-8b55-b5d0b5d26242</uuid>
Nov 11 02:14:30 user nova-compute[75215]:   <name>instance-00000034</name>
Nov 11 02:14:30 user nova-compute[75215]:   <memory>524288</memory>
Nov 11 02:14:30 user nova-compute[75215]:   <vcpu>1</vcpu>
Nov 11 02:14:30 user nova-compute[75215]:   <metadata>
Nov 11 02:14:30 user nova-compute[75215]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 02:14:30 user nova-compute[75215]:       <nova:package version="0.0.0"/>
Nov 11 02:14:30 user nova-compute[75215]:       <nova:name>tempest-TestVolumeBootPattern-server-1090435726</nova:name>
Nov 11 02:14:30 user nova-compute[75215]:       <nova:creationTime>2023-11-11 02:14:29</nova:creationTime>
Nov 11 02:14:30 user nova-compute[75215]:       <nova:flavor name="m1.tiny">
Nov 11 02:14:30 user nova-compute[75215]:         <nova:memory>512</nova:memory>
Nov 11 02:14:30 user nova-compute[75215]:         <nova:disk>1</nova:disk>
Nov 11 02:14:30 user nova-compute[75215]:         <nova:swap>0</nova:swap>
Nov 11 02:14:30 user nova-compute[75215]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 02:14:30 user nova-compute[75215]:         <nova:vcpus>1</nova:vcpus>
Nov 11 02:14:30 user nova-compute[75215]:       </nova:flavor>
Nov 11 02:14:30 user nova-compute[75215]:       <nova:owner>
Nov 11 02:14:30 user nova-compute[75215]:         <nova:user uuid="195d763c024c4db99be056d17d243171">tempest-TestVolumeBootPattern-1487726842-project-member</nova:user>
Nov 11 02:14:30 user nova-compute[75215]:         <nova:project uuid="ca5a366788b744f9b121b9e946ff230f">tempest-TestVolumeBootPattern-1487726842</nova:project>
Nov 11 02:14:30 user nova-compute[75215]:       </nova:owner>
Nov 11 02:14:30 user nova-compute[75215]:       <nova:ports>
Nov 11 02:14:30 user nova-compute[75215]:         <nova:port uuid="8ee3ec7e-1794-4384-acd3-d324b615f3fd">
Nov 11 02:14:30 user nova-compute[75215]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 02:14:30 user nova-compute[75215]:         </nova:port>
Nov 11 02:14:30 user nova-compute[75215]:       </nova:ports>
Nov 11 02:14:30 user nova-compute[75215]:     </nova:instance>
Nov 11 02:14:30 user nova-compute[75215]:   </metadata>
Nov 11 02:14:30 user nova-compute[75215]:   <sysinfo type="smbios">
Nov 11 02:14:30 user nova-compute[75215]:     <system>
Nov 11 02:14:30 user nova-compute[75215]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 02:14:30 user nova-compute[75215]:       <entry name="product">OpenStack Nova</entry>
Nov 11 02:14:30 user nova-compute[75215]:       <entry name="version">0.0.0</entry>
Nov 11 02:14:30 user nova-compute[75215]:       <entry name="serial">78d6d883-986b-40a9-8b55-b5d0b5d26242</entry>
Nov 11 02:14:30 user nova-compute[75215]:       <entry name="uuid">78d6d883-986b-40a9-8b55-b5d0b5d26242</entry>
Nov 11 02:14:30 user nova-compute[75215]:       <entry name="family">Virtual Machine</entry>
Nov 11 02:14:30 user nova-compute[75215]:     </system>
Nov 11 02:14:30 user nova-compute[75215]:   </sysinfo>
Nov 11 02:14:30 user nova-compute[75215]:   <os>
Nov 11 02:14:30 user nova-compute[75215]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 02:14:30 user nova-compute[75215]:     <boot dev="hd"/>
Nov 11 02:14:30 user nova-compute[75215]:     <smbios mode="sysinfo"/>
Nov 11 02:14:30 user nova-compute[75215]:   </os>
Nov 11 02:14:30 user nova-compute[75215]:   <features>
Nov 11 02:14:30 user nova-compute[75215]:     <acpi/>
Nov 11 02:14:30 user nova-compute[75215]:     <apic/>
Nov 11 02:14:30 user nova-compute[75215]:     <vmcoreinfo/>
Nov 11 02:14:30 user nova-compute[75215]:   </features>
Nov 11 02:14:30 user nova-compute[75215]:   <clock offset="utc">
Nov 11 02:14:30 user nova-compute[75215]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 02:14:30 user nova-compute[75215]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 02:14:30 user nova-compute[75215]:     <timer name="hpet" present="no"/>
Nov 11 02:14:30 user nova-compute[75215]:   </clock>
Nov 11 02:14:30 user nova-compute[75215]:   <cpu mode="custom" match="exact">
Nov 11 02:14:30 user nova-compute[75215]:     <model>Nehalem</model>
Nov 11 02:14:30 user nova-compute[75215]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 02:14:30 user nova-compute[75215]:   </cpu>
Nov 11 02:14:30 user nova-compute[75215]:   <devices>
Nov 11 02:14:30 user nova-compute[75215]:     <disk type="block" device="disk">
Nov 11 02:14:30 user nova-compute[75215]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 02:14:30 user nova-compute[75215]:       <source dev="/dev/sdc"/>
Nov 11 02:14:30 user nova-compute[75215]:       <target dev="vda" bus="virtio"/>
Nov 11 02:14:30 user nova-compute[75215]:       <serial>ff2ceac9-b880-41da-a956-548f9d958b99</serial>
Nov 11 02:14:30 user nova-compute[75215]:     </disk>
Nov 11 02:14:30 user nova-compute[75215]:     <interface type="ethernet">
Nov 11 02:14:30 user nova-compute[75215]:       <mac address="fa:16:3e:59:6b:87"/>
Nov 11 02:14:30 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:14:30 user nova-compute[75215]:       <mtu size="1442"/>
Nov 11 02:14:30 user nova-compute[75215]:       <target dev="tap8ee3ec7e-17"/>
Nov 11 02:14:30 user nova-compute[75215]:     </interface>
Nov 11 02:14:30 user nova-compute[75215]:     <serial type="pty">
Nov 11 02:14:30 user nova-compute[75215]:       <log file="/opt/stack/data/nova/instances/78d6d883-986b-40a9-8b55-b5d0b5d26242/console.log" append="off"/>
Nov 11 02:14:30 user nova-compute[75215]:     </serial>
Nov 11 02:14:30 user nova-compute[75215]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 02:14:30 user nova-compute[75215]:     <video>
Nov 11 02:14:30 user nova-compute[75215]:       <model type="virtio"/>
Nov 11 02:14:30 user nova-compute[75215]:     </video>
Nov 11 02:14:30 user nova-compute[75215]:     <rng model="virtio">
Nov 11 02:14:30 user nova-compute[75215]:       <backend model="random">/dev/urandom</backend>
Nov 11 02:14:30 user nova-compute[75215]:     </rng>
Nov 11 02:14:30 user nova-compute[75215]:     <controller type="usb" index="0" model="none"/>
Nov 11 02:14:30 user nova-compute[75215]:     <memballoon model="virtio">
Nov 11 02:14:30 user nova-compute[75215]:       <stats period="10"/>
Nov 11 02:14:30 user nova-compute[75215]:     </memballoon>
Nov 11 02:14:30 user nova-compute[75215]:   </devices>
Nov 11 02:14:30 user nova-compute[75215]: </domain>
Nov 11 02:14:30 user nova-compute[75215]:  {{(pid=75215) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1090435726',display_name='tempest-TestVolumeBootPattern-server-1090435726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1090435726',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-j7fujn17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T02:14:05Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=78d6d883-986b-40a9-8b55-b5d0b5d26242,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:6b:87,bridge_name='br-int',has_traffic_filtering=True,id=8ee3ec7e-1794-4384-acd3-d324b615f3fd,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee3ec7e-17') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG os_vif [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:6b:87,bridge_name='br-int',has_traffic_filtering=True,id=8ee3ec7e-1794-4384-acd3-d324b615f3fd,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee3ec7e-17') {{(pid=75215) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1c58515-a569-5586-a045-2a27e2604e62', '_type': 'linux-noop'}}, row=False) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ee3ec7e-17, may_exist=True, interface_attrs={}) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ee3ec7e-17, col_values=(('qos', UUID('6ffc1886-e9f6-4b95-910d-9fc07afd83e7')),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ee3ec7e-17, col_values=(('external_ids', {'iface-id': '8ee3ec7e-1794-4384-acd3-d324b615f3fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:6b:87', 'vm-uuid': '78d6d883-986b-40a9-8b55-b5d0b5d26242'}),), if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:30 user nova-compute[75215]: INFO os_vif [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:6b:87,bridge_name='br-int',has_traffic_filtering=True,id=8ee3ec7e-1794-4384-acd3-d324b615f3fd,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee3ec7e-17')
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75215) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 02:14:30 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] No VIF found with MAC fa:16:3e:59:6b:87, not building metadata {{(pid=75215) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 02:14:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:31 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-6b83cf0a-372a-4565-a4de-69bc5352c0b6 req-dc64b975-79c1-4e3f-a7fb-6873450ea45e service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:14:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b83cf0a-372a-4565-a4de-69bc5352c0b6 req-dc64b975-79c1-4e3f-a7fb-6873450ea45e service nova] Acquiring lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:14:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b83cf0a-372a-4565-a4de-69bc5352c0b6 req-dc64b975-79c1-4e3f-a7fb-6873450ea45e service nova] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:14:32 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-6b83cf0a-372a-4565-a4de-69bc5352c0b6 req-dc64b975-79c1-4e3f-a7fb-6873450ea45e service nova] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:14:32 user nova-compute[75215]: DEBUG nova.compute.manager [req-6b83cf0a-372a-4565-a4de-69bc5352c0b6 req-dc64b975-79c1-4e3f-a7fb-6873450ea45e service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] No waiting events found dispatching network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:14:32 user nova-compute[75215]: WARNING nova.compute.manager [req-6b83cf0a-372a-4565-a4de-69bc5352c0b6 req-dc64b975-79c1-4e3f-a7fb-6873450ea45e service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received unexpected event network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd for instance with vm_state building and task_state spawning.
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Instance event wait completed in 0 seconds for  {{(pid=75215) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Guest created on hypervisor {{(pid=75215) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 02:14:33 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Instance spawned successfully.
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Found default for hw_cdrom_bus of ide {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Found default for hw_disk_bus of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Found default for hw_input_bus of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Found default for hw_pointer_model of None {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Found default for hw_video_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:14:33 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Found default for hw_vif_model of virtio {{(pid=75215) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 02:14:34 user nova-compute[75215]: INFO nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 11 02:14:34 user nova-compute[75215]: DEBUG nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Checking state {{(pid=75215) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 02:14:34 user nova-compute[75215]: INFO nova.compute.manager [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Took 29.38 seconds to build instance.
Nov 11 02:14:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c379a69-edde-4bf6-9ce7-e7f36ed277a0 req-5447c073-d561-46a9-b52a-84302e333387 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:14:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c379a69-edde-4bf6-9ce7-e7f36ed277a0 req-5447c073-d561-46a9-b52a-84302e333387 service nova] Acquiring lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:14:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c379a69-edde-4bf6-9ce7-e7f36ed277a0 req-5447c073-d561-46a9-b52a-84302e333387 service nova] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:14:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-0c379a69-edde-4bf6-9ce7-e7f36ed277a0 req-5447c073-d561-46a9-b52a-84302e333387 service nova] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:14:34 user nova-compute[75215]: DEBUG nova.compute.manager [req-0c379a69-edde-4bf6-9ce7-e7f36ed277a0 req-5447c073-d561-46a9-b52a-84302e333387 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] No waiting events found dispatching network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:14:34 user nova-compute[75215]: WARNING nova.compute.manager [req-0c379a69-edde-4bf6-9ce7-e7f36ed277a0 req-5447c073-d561-46a9-b52a-84302e333387 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received unexpected event network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd for instance with vm_state active and task_state None.
Nov 11 02:14:34 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-cf5266d6-6216-4acf-9652-4d677bde1c0f tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.479s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:14:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:14:40 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:14:40 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:14:40 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8864MB free_disk=25.13577651977539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance bfec93df-fc0b-4f42-b988-4dadff960763 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 78d6d883-986b-40a9-8b55-b5d0b5d26242 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:14:40 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:14:41 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:14:41 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:14:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:14:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:14:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:14:50 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:50 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:14:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:14:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:14:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:14:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:14:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:14:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid bfec93df-fc0b-4f42-b988-4dadff960763 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:14:55 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:14:55 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:14:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:14:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:14:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:14:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:05 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:06 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:15:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:10 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:15:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:15 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:20 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:25 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:15:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:30 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:15:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:35 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:40 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:15:41 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:15:41 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:15:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.135116577148438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance bfec93df-fc0b-4f42-b988-4dadff960763 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance 78d6d883-986b-40a9-8b55-b5d0b5d26242 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:15:41 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:15:42 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:15:42 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:15:42 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:15:42 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:15:45 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:15:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:15:50 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updating instance_info_cache with network_info: [{"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:15:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:55 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-94cc2822-bd67-4951-8d31-08c51ec115ef req-a6d0220f-75c0-4d5c-aeb0-e22b7da0a01c service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-changed-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:15:56 user nova-compute[75215]: DEBUG nova.compute.manager [req-94cc2822-bd67-4951-8d31-08c51ec115ef req-a6d0220f-75c0-4d5c-aeb0-e22b7da0a01c service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Refreshing instance network info cache due to event network-changed-8ee3ec7e-1794-4384-acd3-d324b615f3fd. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:15:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94cc2822-bd67-4951-8d31-08c51ec115ef req-a6d0220f-75c0-4d5c-aeb0-e22b7da0a01c service nova] Acquiring lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:15:56 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94cc2822-bd67-4951-8d31-08c51ec115ef req-a6d0220f-75c0-4d5c-aeb0-e22b7da0a01c service nova] Acquired lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:15:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-94cc2822-bd67-4951-8d31-08c51ec115ef req-a6d0220f-75c0-4d5c-aeb0-e22b7da0a01c service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Refreshing network info cache for port 8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:15:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-94cc2822-bd67-4951-8d31-08c51ec115ef req-a6d0220f-75c0-4d5c-aeb0-e22b7da0a01c service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updated VIF entry in instance network info cache for port 8ee3ec7e-1794-4384-acd3-d324b615f3fd. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:15:56 user nova-compute[75215]: DEBUG nova.network.neutron [req-94cc2822-bd67-4951-8d31-08c51ec115ef req-a6d0220f-75c0-4d5c-aeb0-e22b7da0a01c service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updating instance_info_cache with network_info: [{"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:15:57 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-94cc2822-bd67-4951-8d31-08c51ec115ef req-a6d0220f-75c0-4d5c-aeb0-e22b7da0a01c service nova] Releasing lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-4291f795-d9d5-4d1e-a0eb-4b5082c57fd5 req-7d821511-ccbd-4d3d-a6ac-a1f523c36fec service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-changed-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG nova.compute.manager [req-4291f795-d9d5-4d1e-a0eb-4b5082c57fd5 req-7d821511-ccbd-4d3d-a6ac-a1f523c36fec service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Refreshing instance network info cache due to event network-changed-8ee3ec7e-1794-4384-acd3-d324b615f3fd. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4291f795-d9d5-4d1e-a0eb-4b5082c57fd5 req-7d821511-ccbd-4d3d-a6ac-a1f523c36fec service nova] Acquiring lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4291f795-d9d5-4d1e-a0eb-4b5082c57fd5 req-7d821511-ccbd-4d3d-a6ac-a1f523c36fec service nova] Acquired lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-4291f795-d9d5-4d1e-a0eb-4b5082c57fd5 req-7d821511-ccbd-4d3d-a6ac-a1f523c36fec service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Refreshing network info cache for port 8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "78d6d883-986b-40a9-8b55-b5d0b5d26242" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:15:58 user nova-compute[75215]: INFO nova.compute.manager [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Terminating instance
Nov 11 02:15:58 user nova-compute[75215]: DEBUG nova.compute.manager [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-4291f795-d9d5-4d1e-a0eb-4b5082c57fd5 req-7d821511-ccbd-4d3d-a6ac-a1f523c36fec service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updated VIF entry in instance network info cache for port 8ee3ec7e-1794-4384-acd3-d324b615f3fd. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG nova.network.neutron [req-4291f795-d9d5-4d1e-a0eb-4b5082c57fd5 req-7d821511-ccbd-4d3d-a6ac-a1f523c36fec service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updating instance_info_cache with network_info: [{"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:15:58 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-4291f795-d9d5-4d1e-a0eb-4b5082c57fd5 req-7d821511-ccbd-4d3d-a6ac-a1f523c36fec service nova] Releasing lock "refresh_cache-78d6d883-986b-40a9-8b55-b5d0b5d26242" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:15:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Instance destroyed successfully.
Nov 11 02:15:59 user nova-compute[75215]: DEBUG nova.objects.instance [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'resources' on Instance uuid 78d6d883-986b-40a9-8b55-b5d0b5d26242 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1090435726',display_name='tempest-TestVolumeBootPattern-server-1090435726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1090435726',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:14:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-j7fujn17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:14:34Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=78d6d883-986b-40a9-8b55-b5d0b5d26242,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "address": "fa:16:3e:59:6b:87", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee3ec7e-17", "ovs_interfaceid": "8ee3ec7e-1794-4384-acd3-d324b615f3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:6b:87,bridge_name='br-int',has_traffic_filtering=True,id=8ee3ec7e-1794-4384-acd3-d324b615f3fd,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee3ec7e-17') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_vif [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:6b:87,bridge_name='br-int',has_traffic_filtering=True,id=8ee3ec7e-1794-4384-acd3-d324b615f3fd,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee3ec7e-17') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ee3ec7e-17, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ffc1886-e9f6-4b95-910d-9fc07afd83e7) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:15:59 user nova-compute[75215]: INFO os_vif [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:6b:87,bridge_name='br-int',has_traffic_filtering=True,id=8ee3ec7e-1794-4384-acd3-d324b615f3fd,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee3ec7e-17')
Nov 11 02:15:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwMyOqAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:15:59 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ba788-9806-4c0d-8e78-ded925111c58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:15:59 user nova-compute[75215]: No targets found.
Nov 11 02:15:59 user nova-compute[75215]: iSNS:
Nov 11 02:15:59 user nova-compute[75215]: No targets found.
Nov 11 02:15:59 user nova-compute[75215]: STATIC:
Nov 11 02:15:59 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99
Nov 11 02:15:59 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:15:59 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:15:59 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1
Nov 11 02:15:59 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:15:59 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:15:59 user nova-compute[75215]: FIRMWARE:
Nov 11 02:15:59 user nova-compute[75215]: No targets found.
Nov 11 02:15:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:15:59 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:15:59 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19893a9-b174-4520-ba92-a05ada653a24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[286dd36b-4536-4119-ad2f-b997d3a26917]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:15:59 user nova-compute[75215]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 (non-flash)
Nov 11 02:15:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:15:59 user nova-compute[75215]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 (non-flash)
Nov 11 02:15:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4020f49900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99'): ({'sdc'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Removing single pathed devices sdc {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69cd689-331f-4e3e-9cda-fcdee7ad0ab6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d60baaa-37f5-46ce-aa1b-18d814bbe7e3]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flushing IO for device /dev/sdc {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb6645-090b-4661-b934-ae36d279f86e]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a53f3ad-fac0-4c80-8b80-a7ce84a22829]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] SCSI volumes sdc have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ba243-2139-459c-a366-5edcd8dbd307]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0c0d6e-ed25-4711-bcbb-7292f69158f4]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99, portal: 172.16.0.220,3260]
Nov 11 02:15:59 user nova-compute[75215]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99, portal: 172.16.0.220,3260] successful.
Nov 11 02:15:59 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff2ceac9-b880-41da-a956-548f9d958b99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf110d3e-5360-4221-82d4-1b4bb4382d66]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== disconnect_volume: return (317ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:15:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Deleting instance files /opt/stack/data/nova/instances/78d6d883-986b-40a9-8b55-b5d0b5d26242_del
Nov 11 02:15:59 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Deletion of /opt/stack/data/nova/instances/78d6d883-986b-40a9-8b55-b5d0b5d26242_del complete
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:15:59 user nova-compute[75215]: INFO nova.compute.manager [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 11 02:15:59 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:15:59 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:16:00 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Took 0.43 seconds to deallocate network for instance.
Nov 11 02:16:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-95fa6ff9-a618-4426-b0e2-1df5f166005e req-42000d9e-a3e2-470b-a8d0-d706626a1c11 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-vif-deleted-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-vif-unplugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] Acquiring lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] No waiting events found dispatching network-vif-unplugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-vif-unplugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received event network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] Acquiring lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG nova.compute.manager [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] No waiting events found dispatching network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:16:00 user nova-compute[75215]: WARNING nova.compute.manager [req-157af360-273f-4f83-b755-c6e0174805c9 req-cca71416-9a0e-46fe-80dd-f4fe50b711d2 service nova] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Received unexpected event network-vif-plugged-8ee3ec7e-1794-4384-acd3-d324b615f3fd for instance with vm_state active and task_state deleting.
Nov 11 02:16:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:00 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:16:01 user nova-compute[75215]: INFO nova.compute.manager [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: 78d6d883-986b-40a9-8b55-b5d0b5d26242] Took 1.05 seconds to detach 1 volumes for instance.
Nov 11 02:16:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:16:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:16:01 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:16:01 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:16:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:16:01 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Deleted allocations for instance 78d6d883-986b-40a9-8b55-b5d0b5d26242
Nov 11 02:16:01 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-d515bee2-1a2a-4e32-84ac-74af334c9cb5 tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "78d6d883-986b-40a9-8b55-b5d0b5d26242" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.093s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:16:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:16:05 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 02:16:05 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] There are 0 instances to clean {{(pid=75215) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 02:16:08 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:16:11 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:16:18 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:16:19 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:19 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Triggering sync for uuid bfec93df-fc0b-4f42-b988-4dadff960763 {{(pid=75215) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 02:16:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "bfec93df-fc0b-4f42-b988-4dadff960763" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:16:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "bfec93df-fc0b-4f42-b988-4dadff960763" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:16:19 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "bfec93df-fc0b-4f42-b988-4dadff960763" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:16:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:16:27 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:27 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75215) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 02:16:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:16:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:16:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:16:43 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:16:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:16:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:16:43 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:16:43 user nova-compute[75215]: DEBUG nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75215) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 02:16:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:16:43 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:16:43 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=25.118621826171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:16:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:16:43 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Instance bfec93df-fc0b-4f42-b988-4dadff960763 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75215) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing inventories for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating ProviderTree inventory for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Updating inventory in ProviderTree for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing aggregate associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, aggregates: None {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Refreshing trait associations for resource provider d4069c05-e0f6-4cda-a48f-ad6318f28710, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75215) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:16:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:16:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:16:52 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:52 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquired lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Forcefully refreshing network info cache for instance {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG nova.objects.instance [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lazy-loading 'info_cache' on Instance uuid bfec93df-fc0b-4f42-b988-4dadff960763 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG nova.network.neutron [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Releasing lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updated the network info_cache for instance {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 02:16:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:16:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:00 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:09 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:12 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:23 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-13ee181b-42ef-469d-b2f6-f53fbdee80bb req-69b80a2e-9e97-47cd-8df0-7a2a9069aca5 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-changed-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.compute.manager [req-13ee181b-42ef-469d-b2f6-f53fbdee80bb req-69b80a2e-9e97-47cd-8df0-7a2a9069aca5 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Refreshing instance network info cache due to event network-changed-c466850d-d032-4a7f-b54f-37d880466e5b. {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-13ee181b-42ef-469d-b2f6-f53fbdee80bb req-69b80a2e-9e97-47cd-8df0-7a2a9069aca5 service nova] Acquiring lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-13ee181b-42ef-469d-b2f6-f53fbdee80bb req-69b80a2e-9e97-47cd-8df0-7a2a9069aca5 service nova] Acquired lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-13ee181b-42ef-469d-b2f6-f53fbdee80bb req-69b80a2e-9e97-47cd-8df0-7a2a9069aca5 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Refreshing network info cache for port c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "bfec93df-fc0b-4f42-b988-4dadff960763" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "bfec93df-fc0b-4f42-b988-4dadff960763" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:17:24 user nova-compute[75215]: INFO nova.compute.manager [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Terminating instance
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.compute.manager [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Start destroying the instance on the hypervisor. {{(pid=75215) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-13ee181b-42ef-469d-b2f6-f53fbdee80bb req-69b80a2e-9e97-47cd-8df0-7a2a9069aca5 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updated VIF entry in instance network info cache for port c466850d-d032-4a7f-b54f-37d880466e5b. {{(pid=75215) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.network.neutron [req-13ee181b-42ef-469d-b2f6-f53fbdee80bb req-69b80a2e-9e97-47cd-8df0-7a2a9069aca5 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [{"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-13ee181b-42ef-469d-b2f6-f53fbdee80bb req-69b80a2e-9e97-47cd-8df0-7a2a9069aca5 service nova] Releasing lock "refresh_cache-bfec93df-fc0b-4f42-b988-4dadff960763" {{(pid=75215) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: INFO nova.virt.libvirt.driver [-] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Instance destroyed successfully.
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.objects.instance [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lazy-loading 'resources' on Instance uuid bfec93df-fc0b-4f42-b988-4dadff960763 {{(pid=75215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.vif [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T02:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-168472537',display_name='tempest-TestVolumeBootPattern-server-168472537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-168472537',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANa8957UYhWLIDmFz2OntnVCiqBTggIYMzXgpqzBg4uc5q8XuH6SH3T07j6p0mrIuSPFX6DsYItL5SMrgArvPtXoIFn+bzISxg+vUgpf2QKgXhK10YHqc6Ve+hvZzXEUw==',key_name='tempest-TestVolumeBootPattern-1451710545',keypairs=<?>,launch_index=0,launched_at=2023-11-11T02:11:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca5a366788b744f9b121b9e946ff230f',ramdisk_id='',reservation_id='r-0es4mdey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1487726842',owner_user_name='tempest-TestVolumeBootPattern-1487726842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T02:11:55Z,user_data=None,user_id='195d763c024c4db99be056d17d243171',uuid=bfec93df-fc0b-4f42-b988-4dadff960763,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converting VIF {"id": "c466850d-d032-4a7f-b54f-37d880466e5b", "address": "fa:16:3e:df:a9:8e", "network": {"id": "4c7e5d5b-566d-4405-866f-0e48b273aeb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2115971418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca5a366788b744f9b121b9e946ff230f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc466850d-d0", "ovs_interfaceid": "c466850d-d032-4a7f-b54f-37d880466e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.network.os_vif_util [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:a9:8e,bridge_name='br-int',has_traffic_filtering=True,id=c466850d-d032-4a7f-b54f-37d880466e5b,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc466850d-d0') {{(pid=75215) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG os_vif [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:a9:8e,bridge_name='br-int',has_traffic_filtering=True,id=c466850d-d032-4a7f-b54f-37d880466e5b,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc466850d-d0') {{(pid=75215) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc466850d-d0, bridge=br-int, if_exists=True) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7042c50-fe58-46f0-a38e-0c25f081c8dc) {{(pid=75215) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:24 user nova-compute[75215]: INFO os_vif [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:a9:8e,bridge_name='br-int',has_traffic_filtering=True,id=c466850d-d032-4a7f-b54f-37d880466e5b,network=Network(4c7e5d5b-566d-4405-866f-0e48b273aeb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc466850d-d0')
Nov 11 02:17:24 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] calling os-brick to detach iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f40642988e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKuREMTp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 02:17:24 user nova-compute[75215]: WARNING os_brick.initiator.connectors.base [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 02:17:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[9742b781-9ead-4732-8b3e-d3a863784d10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 02:17:24 user nova-compute[75215]: No targets found.
Nov 11 02:17:24 user nova-compute[75215]: iSNS:
Nov 11 02:17:24 user nova-compute[75215]: No targets found.
Nov 11 02:17:24 user nova-compute[75215]: STATIC:
Nov 11 02:17:24 user nova-compute[75215]: Target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1
Nov 11 02:17:24 user nova-compute[75215]:         Portal: 172.16.0.220:3260,-1
Nov 11 02:17:24 user nova-compute[75215]:                 Iface Name: default
Nov 11 02:17:24 user nova-compute[75215]: FIRMWARE:
Nov 11 02:17:24 user nova-compute[75215]: No targets found.
Nov 11 02:17:24 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 02:17:24 user nova-compute[75215]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 02:17:24 user nova-compute[75215]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75215) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1', 0)] {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[606e9e0b-e1ab-4bab-af8e-a0ef984a1ef9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:24 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[b870fb85-2d3f-4c43-8a5c-bf121560e058]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:17:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 (non-flash)
Nov 11 02:17:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f40644caa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1'): ({'sdb'}, set())}) {{(pid=75215) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Removing single pathed devices sdb {{(pid=75215) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[726c2b53-273f-4659-90ec-0cf02f03d229]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd568f-bc7b-4f84-b2ae-a5b7f7e4dba6]: (4, ('ok\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Flushing IO for device /dev/sdb {{(pid=75215) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[227f5335-c290-4629-91b3-9fc8333788a9]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75215) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc00c00-eadf-482c-b1d2-30e7c832f321]: (4, ('1', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.linuxscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] SCSI volumes sdb have been removed. {{(pid=75215) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5e3239c8', '/dev/disk/by-id/scsi-1SCST_BIO5e3239c8-c2a88a3d78232e8e', '/dev/disk/by-id/scsi-26332613838613364') {{(pid=86647) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f6b93e-c8af-4687-a36d-21fbc7626cc6]: (4, None) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1')] {{(pid=75215) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c61fd2-af2a-4a18-a60b-e2326c72e5a1]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --logout {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedef6e8-1aa6-45e4-ac63-da117e36c4ee]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260]
Nov 11 02:17:25 user nova-compute[75215]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1, portal: 172.16.0.220,3260] successful.
Nov 11 02:17:25 user nova-compute[75215]:  stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op delete {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf9e5fb2-187e-4933-a4fa-b28822c8f6a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86647) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.privsep.daemon [-] privsep: reply[c266aaee-58d2-4156-b746-50c592b09107]: (4, ('', '')) {{(pid=86647) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75215) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.base [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG os_brick.initiator.connectors.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] <== disconnect_volume: return (282ms) None {{(pid=75215) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Disconnected iSCSI Volume {{(pid=75215) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 02:17:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Deleting instance files /opt/stack/data/nova/instances/bfec93df-fc0b-4f42-b988-4dadff960763_del
Nov 11 02:17:25 user nova-compute[75215]: INFO nova.virt.libvirt.driver [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Deletion of /opt/stack/data/nova/instances/bfec93df-fc0b-4f42-b988-4dadff960763_del complete
Nov 11 02:17:25 user nova-compute[75215]: INFO nova.compute.manager [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 11 02:17:25 user nova-compute[75215]: DEBUG oslo.service.loopingcall [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75215) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG nova.compute.manager [-] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Deallocating network for instance {{(pid=75215) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] deallocate_for_instance() {{(pid=75215) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 02:17:25 user nova-compute[75215]: DEBUG nova.network.neutron [-] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Updating instance_info_cache with network_info: [] {{(pid=75215) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 02:17:25 user nova-compute[75215]: INFO nova.compute.manager [-] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Took 0.44 seconds to deallocate network for instance.
Nov 11 02:17:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-vif-unplugged-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] Acquiring lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] No waiting events found dispatching network-vif-unplugged-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-vif-unplugged-c466850d-d032-4a7f-b54f-37d880466e5b for instance with task_state deleting. {{(pid=75215) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] Acquiring lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] Lock "bfec93df-fc0b-4f42-b988-4dadff960763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] No waiting events found dispatching network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 02:17:26 user nova-compute[75215]: WARNING nova.compute.manager [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received unexpected event network-vif-plugged-c466850d-d032-4a7f-b54f-37d880466e5b for instance with vm_state active and task_state deleting.
Nov 11 02:17:26 user nova-compute[75215]: DEBUG nova.compute.manager [req-f558c48b-dbfa-40a4-8b20-f07a6f1c1601 req-a9a015e9-5970-49ba-bfbd-3aeda74419e2 service nova] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Received event network-vif-deleted-c466850d-d032-4a7f-b54f-37d880466e5b {{(pid=75215) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 02:17:26 user nova-compute[75215]: INFO nova.compute.manager [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] [instance: bfec93df-fc0b-4f42-b988-4dadff960763] Took 0.99 seconds to detach 1 volumes for instance.
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:17:26 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:17:26 user nova-compute[75215]: INFO nova.scheduler.client.report [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Deleted allocations for instance bfec93df-fc0b-4f42-b988-4dadff960763
Nov 11 02:17:27 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-84619b39-de76-45e1-bbf0-714ba1cd362a tempest-TestVolumeBootPattern-1487726842 tempest-TestVolumeBootPattern-1487726842-project-member] Lock "bfec93df-fc0b-4f42-b988-4dadff960763" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.985s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:17:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:17:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:17:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:17:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:17:44 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:17:44 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:17:44 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=9146MB free_disk=25.11762237548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:17:44 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:17:45 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:17:45 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:17:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:17:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:17:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:17:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:17:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:17:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:17:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 02:17:59 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:18:01 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:02 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:04 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:04 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:18:09 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:18:10 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:13 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:14 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:17 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:19 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:18:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75215) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 02:18:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:18:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75215) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 02:18:24 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:26 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:29 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:32 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:34 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:39 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:18:44 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Auditing locally available compute resources for user (node: user) {{(pid=75215) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 02:18:45 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:18:45 user nova-compute[75215]: WARNING nova.virt.libvirt.driver [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 02:18:45 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Hypervisor/Node resource view: name=user free_ram=9273MB free_disk=25.112152099609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75215) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75215) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG nova.compute.provider_tree [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed in ProviderTree for provider: d4069c05-e0f6-4cda-a48f-ad6318f28710 {{(pid=75215) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG nova.scheduler.client.report [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Inventory has not changed for provider d4069c05-e0f6-4cda-a48f-ad6318f28710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75215) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG nova.compute.resource_tracker [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Compute_service record updated for user:user {{(pid=75215) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 02:18:45 user nova-compute[75215]: DEBUG oslo_concurrency.lockutils [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=75215) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 02:18:49 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 02:18:53 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:53 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75215) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 02:18:54 user nova-compute[75215]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75215) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 02:18:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 02:18:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Starting heal instance info cache {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 02:18:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Rebuilding the list of instances to heal {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 02:18:55 user nova-compute[75215]: DEBUG nova.compute.manager [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Didn't find any instances for network info cache update. {{(pid=75215) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 02:18:55 user nova-compute[75215]: DEBUG oslo_service.periodic_task [None req-414c7021-86b1-4db4-beea-4b3d09e8e00e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75215) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}